分布式scrapy-redis爬虫！糗事百科

分布式scrapy-redis爬虫！糗事百科

from scrapy import cmdline
cmdline.execute（‘scrapy crawl qiushi‘.split（））

 属性            大小     日期    时间   名称
----------- ---------  ---------- -----  ----
     目录           0  2019-05-24 20:01  duanzi\
     目录           0  2019-05-25 14:08  duanzi\.idea\
     文件         478  2019-05-18 09:32  duanzi\.idea\duanzi.iml
     文件         188  2019-05-18 09:31  duanzi\.idea\misc.xml
     文件         271  2019-05-18 09:31  duanzi\.idea\modules.xml
     文件       20076  2019-05-25 14:08  duanzi\.idea\workspace.xml
     目录           0  2019-05-25 10:45  duanzi\duanzi\
     目录           0  2019-05-25 13:59  duanzi\duanzi\duanzi\
     文件           0  2019-03-14 09:30  duanzi\duanzi\duanzi\__init__.py
     目录           0  2019-05-25 14:00  duanzi\duanzi\duanzi\__pycache__\
     文件         125  2019-05-18 09:31  duanzi\duanzi\duanzi\__pycache__\__init__.cpython-35.pyc
     文件         371  2019-05-18 10:26  duanzi\duanzi\duanzi\__pycache__\items.cpython-35.pyc
     文件        1129  2019-05-25 14:00  duanzi\duanzi\duanzi\__pycache__\pipelines.cpython-35.pyc
     文件         871  2019-05-25 11:52  duanzi\duanzi\duanzi\__pycache__\settings.cpython-35.pyc
     文件          74  2019-05-18 09:43  duanzi\duanzi\duanzi\gogogo.py
     文件         255  2019-05-18 10:09  duanzi\duanzi\duanzi\items.py
     文件        3597  2019-05-18 09:29  duanzi\duanzi\duanzi\middlewares.py
     文件         840  2019-05-25 13:59  duanzi\duanzi\duanzi\pipelines.py
     文件        4396  2019-05-25 11:52  duanzi\duanzi\duanzi\settings.py
     目录           0  2019-05-24 15:24  duanzi\duanzi\duanzi\spiders\
     文件         161  2019-03-14 09:30  duanzi\duanzi\duanzi\spiders\__init__.py
     目录           0  2019-05-24 18:44  duanzi\duanzi\duanzi\spiders\__pycache__\
     文件         133  2019-05-18 09:31  duanzi\duanzi\duanzi\spiders\__pycache__\__init__.cpython-35.pyc
     文件        1116  2019-05-24 18:44  duanzi\duanzi\duanzi\spiders\__pycache__\qiushi.cpython-35.pyc
     文件         835  2019-05-24 15:24  duanzi\duanzi\duanzi\spiders\qiushi.py
     文件         255  2019-05-18 09:29  duanzi\duanzi\scrapy.cfg