Py爬虫自学路线

1.JSON数据格式

https://www.cnblogs.com/tech-bird/p/3588430.html

2.python3中的urllib包

官方文档：https://docs.python.org/3.5/library/urllib.html

中文翻译版：https://blog.csdn.net/Jurbo/article/details/52313636

Request对象：https://blog.csdn.net/weixin_37598106/article/details/72852220

urllib.parse包：https://docs.python.org/3/library/urllib.parse.html

3.http请求头中User-Agent用户代理

https://www.jianshu.com/p/c5cf6a1967d1

4.重定向

https://baike.baidu.com/item/%E9%87%8D%E5%AE%9A%E5%90%91 

5.《python3网络爬虫开发实战》崔庆才著

6.字节流与字符流的区别

https://blog.csdn.net/zxman660/article/details/7875799

7.utf-8转换工具

https://www.sojson.com/utf8.html 

utf-8/unicode/ACSII学习

http://www.ruanyifeng.com/blog/2007/10/ascii_unicode_and_utf-8.html

8.向文件追加内容

https://www.cnblogs.com/feiyueNotes/p/7897064.html

9.yield使用方法

https://blog.csdn.net/mieleizhi0522/article/details/82142856 

10.json.dump()

https://www.cnblogs.com/xiaomingzaixian/p/7286793.html

11.读取文件

https://www.cnblogs.com/zywscq/p/5441145.html

12.request.session()维持会话保持cookie

https://2.python-requests.org//zh_CN/latest/user/advanced.html

13.python 内置数据库SQLite3

https://www.jianshu.com/p/55df52d386a4

14.SQLite可视化工具

https://blog.csdn.net/shellching/article/details/7979969

15.