项目作者: Mrk-Nguyen

项目描述 :
ETL project to pull Crunchbase news articles into a PostGresSQL Database
高级语言: Jupyter Notebook
项目地址: git://github.com/Mrk-Nguyen/crunchbase-etl-mule.git
创建时间: 2018-10-18T05:15:33Z
项目社区:https://github.com/Mrk-Nguyen/crunchbase-etl-mule

开源协议:

下载


Summary

This is a Mule 4 application that retrieves Crunchbase news articles in batches of 250 and uploads the articles to a PostGresSQL Database.

The program first retrieves a list of companies to retrieve news articles related to that company and proceeds to build the necessary parameters to connect to the Crunchbase API via HTTP.

The application then maps the data returned from the API and uploads the data into a PostGresSQL server.