【Python爬虫】网页抓取实例之淘宝商品信息抓取

小鱼儿 2024-02-19 11:23 195阅读 0赞

之前我们已经说过**网页抓取**的相关内容

上次我们是以亚马逊某网页的产品为例

抓取价格、品牌、型号、样式等

![图片][0da7473d5807d054c62f8d8983b8930d.png]

该网页上价格、品牌、型号、样式等

都只有一个

如果网页上的目标内容

根据不同规格有多个

又该怎么提取呢？

▼如下图所示

![7f54f994ee37403a87d2d0ca9fe14494.png][]

当机身颜色、套餐、存储容量等

规格不同时

对应价格也不同

那该怎么获取不同属性下的价格呢？

此时需要用到抓取商品详情信息的API接口item\_get、或者item\_get\_sku。

详细调用步骤如下：

1、[获取API调用权限，注册key和密钥][API_key]。

2、进入API测试页，输入商品id，调用API。如下图：  
![13de5ec525944cd5895fadef90f11396.png][]

3、找到响应示例中的sku信息

"skus": {
    			"sku": [
    				{
    					"price": 678,
    					"total_price": 0,
    					"orginal_price": 678,
    					"properties": "1627207:1007902496;5919063:6536025;12304035:1905146457",
    					"properties_name": "1627207:1007902496:机身颜色:幻夜黑;5919063:6536025:套餐类型:官方标配 华为nova5i;12304035:1905146457:存储容量:6+128GB",
    					"quantity": 200,
    					"sku_id": "5142540523707"
    				},
    				{
    					"price": 778,
    					"total_price": 0,
    					"orginal_price": 778,
    					"properties": "1627207:1007902496;5919063:6536025;12304035:1963543205",
    					"properties_name": "1627207:1007902496:机身颜色:幻夜黑;5919063:6536025:套餐类型:官方标配 华为nova5i;12304035:1963543205:存储容量:8+128GB",
    					"quantity": 200,
    					"sku_id": "5142540523708"
    				},
    				{
    					"price": 868,
    					"total_price": 0,
    					"orginal_price": 868,
    					"properties": "1627207:1007902496;5919063:3266779;12304035:1905146457",
    					"properties_name": "1627207:1007902496:机身颜色:幻夜黑;5919063:3266779:套餐类型:套餐一 华为nova5por;12304035:1905146457:存储容量:6+128GB",
    					"quantity": 0,
    					"sku_id": "5141622086982"
    				},
    				{
    					"price": 878,
    					"total_price": 0,
    					"orginal_price": 878,
    					"properties": "1627207:1007902496;5919063:3266779;12304035:1963543205",
    					"properties_name": "1627207:1007902496:机身颜色:幻夜黑;5919063:3266779:套餐类型:套餐一 华为nova5por;12304035:1963543205:存储容量:8+128GB",
    					"quantity": 200,
    					"sku_id": "5141622086983"
    				},
    				{
    					"price": 678,
    					"total_price": 0,
    					"orginal_price": 678,
    					"properties": "1627207:2771458827;5919063:6536025;12304035:1905146457",
    					"properties_name": "1627207:2771458827:机身颜色:苏音蓝;5919063:6536025:套餐类型:官方标配 华为nova5i;12304035:1905146457:存储容量:6+128GB",
    					"quantity": 200,
    					"sku_id": "5142540523709"
    				},
    				{
    					"price": 778,
    					"total_price": 0,
    					"orginal_price": 778,
    					"properties": "1627207:2771458827;5919063:6536025;12304035:1963543205",
    					"properties_name": "1627207:2771458827:机身颜色:苏音蓝;5919063:6536025:套餐类型:官方标配 华为nova5i;12304035:1963543205:存储容量:8+128GB",
    					"quantity": 200,
    					"sku_id": "5142540523710"
    				},
    				{
    					"price": 868,
    					"total_price": 0,
    					"orginal_price": 868,
    					"properties": "1627207:2771458827;5919063:3266779;12304035:1905146457",
    					"properties_name": "1627207:2771458827:机身颜色:苏音蓝;5919063:3266779:套餐类型:套餐一 华为nova5por;12304035:1905146457:存储容量:6+128GB",
    					"quantity": 0,
    					"sku_id": "5141622086986"
    				},
    				{
    					"price": 878,
    					"total_price": 0,
    					"orginal_price": 878,
    					"properties": "1627207:2771458827;5919063:3266779;12304035:1963543205",
    					"properties_name": "1627207:2771458827:机身颜色:苏音蓝;5919063:3266779:套餐类型:套餐一 华为nova5por;12304035:1963543205:存储容量:8+128GB",
    					"quantity": 200,
    					"sku_id": "5141622086987"
    				},
    				{
    					"price": 678,
    					"total_price": 0,
    					"orginal_price": 678,
    					"properties": "1627207:1198972384;5919063:6536025;12304035:1905146457",
    					"properties_name": "1627207:1198972384:机身颜色:蜜语红;5919063:6536025:套餐类型:官方标配 华为nova5i;12304035:1905146457:存储容量:6+128GB",
    					"quantity": 200,
    					"sku_id": "5142540523705"
    				},
    				{
    					"price": 778,
    					"total_price": 0,
    					"orginal_price": 778,
    					"properties": "1627207:1198972384;5919063:6536025;12304035:1963543205",
    					"properties_name": "1627207:1198972384:机身颜色:蜜语红;5919063:6536025:套餐类型:官方标配 华为nova5i;12304035:1963543205:存储容量:8+128GB",
    					"quantity": 200,
    					"sku_id": "5142540523706"
    				},
    				{
    					"price": 868,
    					"total_price": 0,
    					"orginal_price": 868,
    					"properties": "1627207:1198972384;5919063:3266779;12304035:1905146457",
    					"properties_name": "1627207:1198972384:机身颜色:蜜语红;5919063:3266779:套餐类型:套餐一 华为nova5por;12304035:1905146457:存储容量:6+128GB",
    					"quantity": 0,
    					"sku_id": "5141622086984"
    				},
    				{
    					"price": 878,
    					"total_price": 0,
    					"orginal_price": 878,
    					"properties": "1627207:1198972384;5919063:3266779;12304035:1963543205",
    					"properties_name": "1627207:1198972384:机身颜色:蜜语红;5919063:3266779:套餐类型:套餐一 华为nova5por;12304035:1963543205:存储容量:8+128GB",
    					"quantity": 200,
    					"sku_id": "5141622086985"
    				},
    				{
    					"price": 678,
    					"total_price": 0,
    					"orginal_price": 678,
    					"properties": "1627207:5860482491;5919063:6536025;12304035:1905146457",
    					"properties_name": "1627207:5860482491:机身颜色:烟雨青蓝;5919063:6536025:套餐类型:官方标配 华为nova5i;12304035:1905146457:存储容量:6+128GB",
    					"quantity": 200,
    					"sku_id": "5142540523711"
    				},
    				{
    					"price": 778,
    					"total_price": 0,
    					"orginal_price": 778,
    					"properties": "1627207:5860482491;5919063:6536025;12304035:1963543205",
    					"properties_name": "1627207:5860482491:机身颜色:烟雨青蓝;5919063:6536025:套餐类型:官方标配 华为nova5i;12304035:1963543205:存储容量:8+128GB",
    					"quantity": 200,
    					"sku_id": "5142540523712"
    				},
    				{
    					"price": 868,
    					"total_price": 0,
    					"orginal_price": 868,
    					"properties": "1627207:5860482491;5919063:3266779;12304035:1905146457",
    					"properties_name": "1627207:5860482491:机身颜色:烟雨青蓝;5919063:3266779:套餐类型:套餐一 华为nova5por;12304035:1905146457:存储容量:6+128GB",
    					"quantity": 0,
    					"sku_id": "5141622086988"
    				},
    				{
    					"price": 878,
    					"total_price": 0,
    					"orginal_price": 878,
    					"properties": "1627207:5860482491;5919063:3266779;12304035:1963543205",
    					"properties_name": "1627207:5860482491:机身颜色:烟雨青蓝;5919063:3266779:套餐类型:套餐一 华为nova5por;12304035:1963543205:存储容量:8+128GB",
    					"quantity": 200,
    					"sku_id": "5141622086989"
    				}
    			]
    		},

[0da7473d5807d054c62f8d8983b8930d.png]: https://image.dandelioncloud.cn/pgy_files/images/2024/02/19/bb08c1eae0594091b811df37fa688405.png
[7f54f994ee37403a87d2d0ca9fe14494.png]: https://image.dandelioncloud.cn/pgy_files/images/2024/02/19/8092f02e24024012a45ec2dacd675d2c.png
[API_key]: https://o0b.cn/jennif
[13de5ec525944cd5895fadef90f11396.png]: https://image.dandelioncloud.cn/pgy_files/images/2024/02/19/ef171e3ff3db4e5480d06ce8838f17e4.png