项目作者: ya9do

项目描述 :
Puppenomist = Scraper for the Economist with Puppeteer
高级语言: JavaScript
项目地址: git://github.com/ya9do/puppenomist.git
创建时间: 2018-08-09T06:20:04Z
项目社区:https://github.com/ya9do/puppenomist

开源协议:MIT License

下载


Puppenomist = Tha Scraper for The Ecnomist with Puppeteer.

How to Use

  1. Install

    1. $ npm install puppenomist
  2. Move to the Installed directory and Run the command

    1. $ cd ./node_modules/puppenomist
    2. $ node index.js -v

    -v option is for NON Headless mode, it might be useful for first trial.

Example

  1. $ node index.js -v
  2. prompt: Email: XXXXXXX@XMAIL.COM
  3. prompt: Password: ********
  4. trying to login...
  5. succeeded to login!
  6. trying to extract issue links...
  7. Issue links extracted!
  8. started https://www.economist.com/printedition/2018-08-11
  9. -->1/77: 2018_08_11_politics-this-week.json saved!
  10. -->2/77: 2018_08_11_business-this-week.json saved!
  11. -->3/77: 2018_08_11_kals-cartoon.json saved!
  12. -->4/77: 2018_08_09_overhaul-tax-for-the-21st-century.json saved!
  13. -->5/77: 2018_08_11_many-american-states-are-making-voting-harder.json saved!
  14. -->6/77: 2018_08_11_the-danger-posed-by-jair-bolsonaro.json saved!
  15. ...

Notes

It requires subscription account for The Ecnomist.