机器学习>> imdb-crawler>> 返回
项目作者： doroudi

项目描述 ：
imdb.com movies crawler in scrapy
高级语言： Python
项目地址: git://github.com/doroudi/imdb-crawler.git
创建时间： 2019-10-14T19:36:06Z
项目社区：https://github.com/doroudi/imdb-crawler
开源协议：
下载


imdb-crawler

imdb.com movies crawler in scrapy and python

Get Movies basic information from imdb.com

returned fields contains :

  • url
  • name
  • image
  • genre
  • contentRating
  • actor
  • creator
  • description
  • datePublished
  • keywords
  • aggregateRating
  • review
  • trailer
  • duration

how to use:

  1. git clone https://github.com/doroudi/imdb-crawler

install scrapy using 

  1. pip install scrapy

or install using Anaconda

run spider

  1. scrapy crawl topMovies -o output.json