Python实现爬取全国疫情数据

港控/mmm° 2023-07-04 11:23 71阅读 0赞

**不信谣不传谣，为武汉祈福，为中国加油！**

1、获取疫情的url【[腾讯新闻肺炎疫情][Link 1]】：

通过打开开发者工具，我们可以看到这样的画面，其次，我们需要找到指向数据的url：

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQyNjgwMzI3_size_16_color_FFFFFF_t_70][]

因此我们可以得到如下数据：

https://view.inews.qq.com/g2/getOnsInfo?name=disease_h5

2、为了避免反爬，伪装成浏览器：

headers = {
            'user-agent': 'Mozilla/5.0 (Linux; Android 6.0; Nexus 5 Build/MRA58N) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/78.0.3904.108 Mobile Safari/537.36'
        }

3、分析url，找到数据存放的规律：

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQyNjgwMzI3_size_16_color_FFFFFF_t_70 1][]

从上图杂乱无章的json数据中，我们不难找到如下规律：

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQyNjgwMzI3_size_16_color_FFFFFF_t_70 2][]

### 效果如图： ###

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQyNjgwMzI3_size_16_color_FFFFFF_t_70 3][]

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQyNjgwMzI3_size_16_color_FFFFFF_t_70 4][]

### 代码如图： ###

#author_='zhi';
    #date: 2020/2/10 17:01
    
    import requests
    import json
    
    def Down_data():
        url = 'https://view.inews.qq.com/g2/getOnsInfo?name=disease_h5'
        headers = {
            'user-agent': 'Mozilla/5.0 (Linux; Android 6.0; Nexus 5 Build/MRA58N) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/78.0.3904.108 Mobile Safari/537.36'
        }
        r = requests.get(url, headers)
        res = json.loads(r.text)
        data_res = json.loads(res['data'])
        return data_res
    
    def Parse_data1():
        data = Down_data()
        list = ['截至时间：' + str(data['lastUpdateTime']) + '\n'
                 '全国确诊人数：' + str(data['chinaTotal']['confirm']) + '\n'
                 '今日新增确诊：' + str(data['chinaAdd']['confirm']) + '\n'
                 '全国疑似：' + str(data['chinaTotal']['suspect']) + '\n'
                 '今日新增疑似：' + str(data['chinaAdd']['suspect']) + '\n'
                 '全国治愈：' + str(data['chinaTotal']['heal']) + '\n'
                 '今日新增治愈：' + str(data['chinaAdd']['heal']) + '\n'
                 '全国死亡：' + str(data['chinaTotal']['dead']) + '\n'
                 '今日新增死亡：' + str(data['chinaAdd']['dead']) + '\n']
        result = ''.join(list)
        with open('疫情查询.txt', 'a+', encoding="utf-8") as f:
            f.write(result + '\n')
    
    def Parse_data2():
        data = Down_data()['areaTree'][0]['children']
        path = str(input('请输入你要查询的省份：'))
        for i in data:
            if path in i['name']:
                for item in i['children']:
                    list_city = [
                        '地区: ' + str(item['name']) + '\n'
                        ' 确诊人数：' + str(item['total']['confirm']),
                        ' 新增确诊：' + str(item['today']['confirm']),
                        ' 治愈：' + str(item['total']['heal']),
                        ' 新增治愈：' + str(item['today']['heal']),
                        ' 死亡：' + str(item['total']['dead']),
                        ' 新增死亡：' + str(item['today']['dead']) + '\n'
                    ]
                    res_city = ''.join(list_city)
                    with open('疫情查询.txt', 'a+', encoding="utf-8") as f:
                        f.write(res_city)
    
    Down_data()
    Parse_data1()
    Parse_data2()

[Link 1]: https://news.qq.com/zt2020/page/feiyan.htm
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQyNjgwMzI3_size_16_color_FFFFFF_t_70]: https://img-blog.csdnimg.cn/20200210171006458.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQyNjgwMzI3,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQyNjgwMzI3_size_16_color_FFFFFF_t_70 1]: https://img-blog.csdnimg.cn/20200210171446432.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQyNjgwMzI3,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQyNjgwMzI3_size_16_color_FFFFFF_t_70 2]: https://img-blog.csdnimg.cn/20200210171558996.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQyNjgwMzI3,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQyNjgwMzI3_size_16_color_FFFFFF_t_70 3]: https://img-blog.csdnimg.cn/20200210172007396.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQyNjgwMzI3,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQyNjgwMzI3_size_16_color_FFFFFF_t_70 4]: https://img-blog.csdnimg.cn/20200210172302507.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQyNjgwMzI3,size_16,color_FFFFFF,t_70