scrapy ---爬取豌豆荚并分析数据

scrapy ---爬取豌豆荚并分析数据,通过scrapy框架获取豌豆荚数据储存在mongodb中，并通过pyecharts 分析结果得到图像分析

# _*_ encoding:utf-8 _*_
# _*_ author:wen _*_
“““
 Created by 黄文财 on 2019/5/7.
 “““

from scrapy.cmdline import execute
import os
import sys
if __name__ == ‘__main__‘:

    sys.path.append（os.path.dirname（os.path.abspath（__file__）））
    execute（[‘scrapy‘‘crawl‘‘wandoujia‘]）

 属性            大小     日期    时间   名称
----------- ---------  ---------- -----  ----
     目录           0  2019-05-15 21:22  wandoujiaScrapy\
     目录           0  2019-05-19 09:36  wandoujiaScrapy\.idea\
     目录           0  2019-05-07 21:01  wandoujiaScrapy\.idea\inspectionProfiles\
     文件         228  2019-05-07 21:01  wandoujiaScrapy\.idea\inspectionProfiles\profiles_settings.xml
     文件         258  2019-05-08 19:09  wandoujiaScrapy\.idea\misc.xml
     文件         282  2019-05-07 21:01  wandoujiaScrapy\.idea\modules.xml
     文件         398  2019-05-07 21:02  wandoujiaScrapy\.idea\wandoujiaScrapy.iml
     文件       49712  2019-05-19 09:36  wandoujiaScrapy\.idea\workspace.xml
     目录           0  2019-05-19 09:01  wandoujiaScrapy\log\
     文件          97  2019-05-07 21:35  wandoujiaScrapy\log\__init__.py
     文件      251765  2019-05-12 15:26  wandoujiaScrapy\log\scrapy_2019_5_12.log
     文件      902059  2019-05-15 23:05  wandoujiaScrapy\log\scrapy_2019_5_15.log
     文件        3729  2019-05-17 08:52  wandoujiaScrapy\log\scrapy_2019_5_17.log
     文件        5097  2019-05-18 21:41  wandoujiaScrapy\log\scrapy_2019_5_18.log
     文件       16539  2019-05-19 09:04  wandoujiaScrapy\log\scrapy_2019_5_19.log
     文件           0  2019-05-07 22:58  wandoujiaScrapy\log\scrapy_2019_5_7.log
     文件           0  2019-05-08 22:25  wandoujiaScrapy\log\scrapy_2019_5_8.log
     文件     1547444  2019-05-09 22:51  wandoujiaScrapy\log\scrapy_2019_5_9.log
     文件         296  2019-05-15 21:22  wandoujiaScrapy\main.py
     文件         273  2019-05-07 20:59  wandoujiaScrapy\scrapy.cfg
     目录           0  2019-05-19 09:03  wandoujiaScrapy\wandoujiaScrapy\
     文件           0  2019-01-29 08:32  wandoujiaScrapy\wandoujiaScrapy\__init__.py
     目录           0  2019-05-19 09:03  wandoujiaScrapy\wandoujiaScrapy\__pycache__\
     文件         155  2019-05-07 21:03  wandoujiaScrapy\wandoujiaScrapy\__pycache__\__init__.cpython-36.pyc
     文件         529  2019-05-08 19:40  wandoujiaScrapy\wandoujiaScrapy\__pycache__\items.cpython-36.pyc
     文件        1799  2019-05-19 09:03  wandoujiaScrapy\wandoujiaScrapy\__pycache__\middlewares.cpython-36.pyc
     文件        5295  2019-05-18 10:24  wandoujiaScrapy\wandoujiaScrapy\__pycache__\pipelines.cpython-36.pyc
     文件        1066  2019-05-18 10:24  wandoujiaScrapy\wandoujiaScrapy\__pycache__\settings.cpython-36.pyc
     文件         634  2019-05-08 19:13  wandoujiaScrapy\wandoujiaScrapy\items.py
     文件        2156  2019-05-19 09:03  wandoujiaScrapy\wandoujiaScrapy\middlewares.py
     文件        4326  2019-05-18 10:24  wandoujiaScrapy\wandoujiaScrapy\pipelines.py
............此处省略26个文件信息