python爬取元气大咖福利妹子图，好不容易遇到一个几乎没有反爬的福利妹子

雨点打透心脏的1/2处 2021-11-16 13:58 271阅读 0赞

先来看看这些妹子符不符合你的胃口，然后再决定盘不盘她，嘻嘻，

## 请看： ##

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80NDc4NjUzMA_size_16_color_FFFFFF_t_70][]

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80NDc4NjUzMA_size_16_color_FFFFFF_t_70 1][]

# #

## 接着分析一些链接的规律： ##

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80NDc4NjUzMA_size_16_color_FFFFFF_t_70 2][]

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80NDc4NjUzMA_size_16_color_FFFFFF_t_70 3][]

## 接着我们就开始盘她吧： ##

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80NDc4NjUzMA_size_16_color_FFFFFF_t_70 4][]

# #

## 代码如下： ##

# 使用xpath提取响应的文章链接和图片链接
    import requests
    import re
    
    class Yuanqi(object):
        def __init__(self):
            self.url = "http://www.iyuanqi.com/flist/26103/new/1.html"
            self.header = {
                "User-Agent": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/75.0.3770.142 Safari/537.36",
            }
    
        def send_all_title(self):
            response =  requests.get(self.url, headers=self.header)
            res_html = response.content.decode("utf-8")
            return res_html
    
        def parse_title_url(self, res_html):
            re_obj = re.compile('<a href="(.*?)" target="_blank" class="block-img has-danmu">')
            url_list = re_obj.findall(res_html)
            return url_list
    
        def send_img_url(self, url):
            res_img_html = requests.get(url, headers=self.header)
            img_re_obj = re.compile('<p style="text-align: center;"><img src="(.*?)"')
            img_url_list = img_re_obj.findall(res_img_html.content.decode("utf-8"))
            return img_url_list
    
        def save_img(self, imgurl):
            image_name = imgurl[-12:]
            print("正在下载妹子{}".format(image_name))
            img_res_cont = requests.get(imgurl, headers=self.header)
            image_path = "some_img/" + image_name
            with open(image_path, "wb") as f:
                f.write(img_res_cont.content)
            print(image_name+"已下载完成哦---------->")
    
        def run(self):
            # 发送基本请求，获取文章列表
            res_html = self.send_all_title()
    
            # 先解析获取文章链接
            url_list = self.parse_title_url(res_html)
    
            # 遍历文章链接发送文章请求
            for url in url_list:
                end_url = "http://www.iyuanqi.com" + url
                img_url_list = self.send_img_url(end_url)
                for imgurl in img_url_list:
                    # 请求图片的链接并保存
                    self.save_img(imgurl)
    
    
    if __name__ == '__main__':
        Yuanqi().run()

# #

## 我的python-spider仓库，里面收集了我学习python爬虫的一些项目和福利哦， ##

## Github地址：[https://github.com/Sjj1024/Python-spider][https_github.com_Sjj1024_Python-spider] ##

[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80NDc4NjUzMA_size_16_color_FFFFFF_t_70]: /images/20211116/1b64ea11f75b4745bbf6981216e161cb.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80NDc4NjUzMA_size_16_color_FFFFFF_t_70 1]: https://img-blog.csdnimg.cn/20190728151951664.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80NDc4NjUzMA==,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80NDc4NjUzMA_size_16_color_FFFFFF_t_70 2]: https://img-blog.csdnimg.cn/20190728152147711.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80NDc4NjUzMA==,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80NDc4NjUzMA_size_16_color_FFFFFF_t_70 3]: /images/20211116/adf1bd9c634e43d189846dbad8d13602.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80NDc4NjUzMA_size_16_color_FFFFFF_t_70 4]: /images/20211116/bc8d308df69f4d1a9c8e075d792f00bf.png
[https_github.com_Sjj1024_Python-spider]: https://github.com/Sjj1024/Python-spider