Python 爬虫 scrapy 利用splash爬取动态网页
转载自 https://blog.csdn.net/mouday/article/details/81625830
依赖库:
pip install scrapy-splash
配置settings.py
# splash服务器地址
SPLASH_URL = 'http://localhost:8050'
# 支持cache_args(可选)
SPIDER_MIDDLEWARES = {
...
转载
2018-10-19 20:22:21 ·
538 阅读 ·
1 评论