Python3 urllib.request与requests模块请求网页代码

not-boom

于 2018-01-29 22:10:27 发布

阅读量2.6k

点赞数

CC 4.0 BY-SA版权

分类专栏：爬虫学习

本文链接：https://blog.csdn.net/weixin_38600067/article/details/79200542

爬虫学习专栏收录该内容

3 篇文章

订阅专栏

本文介绍使用Python通过两种方式(urllib.request 和 requests)来抓取网页数据的方法，并展示了如何解析并打印出天气信息。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

爬虫的起点，获取网页代码

#!/usr/bin/env python3
# -*- encoding:utf-8 -*-

# 请求网页代码

import urllib.request

req = urllib.request.Request('http://www.weather.com.cn/adat/sk/101280101.html')

r = urllib.request.urlopen(req)

result = str(r.read(), encoding='utf-8')

print(result, type(result))


#############################

# requests是第三方模块，与上面urllib.request一样的效果。而且跟方便简洁

import requests

res = requests.get("http://www.weather.com.cn/adat/sk/101280101.html")

res.encoding = 'utf-8'

r = res.text

print(type(r), r)

#<class 'str'> {"weatherinfo":{"city":"广州","cityid":"101280101","temp":"24","WD":"东南风","WS":"3级","SD":"80%","WSE":"3","time":"10:25","isRadar":"1","Radar":"JC_RADAR_AZ9200_JB","njd":"暂无实况","qy":"1001"}}