项目作者: mroswell

项目描述 :
EPA List of COVID-19 Disinfectants
高级语言:
项目地址: git://github.com/mroswell/list-N.git
创建时间: 2021-03-04T22:50:24Z
项目社区:https://github.com/mroswell/list-N

开源协议:

下载


EPA List of COVID-19 Disinfectants (List N)

Installation

  1. brew install datasette sqlite-utils
  2. pip3 install datasette-publish-vercel
  3. or
  4. datasette install datasette-publish-vercel

Import data

  1. cd Projects/Advocacy/list-N/list-N
  2. sqlite-utils insert list-N.db listN list-N.csv --csv
  3. or
  4. curl "https://cfpub.epa.gov/wizards/disinfectants/includes/queries.cfc?method=getDisData&Keyword=&RegNum=&ActiveIng=All&ContactTime=&UseSite=&SurfType="
  5. (was:
  6. curl 'https://cfpub.epa.gov/giwiz/disinfectants/includes/queries.cfc?method=getDisData&Keyword=&RegNum=&ActiveIng=All&ContactTime=&UseSite=&SurfType=' | python transform.py | jq . | sqlite-utils insert disinfectants.db listN - --pk ID
  7. )
  1. sqlite-utils enable-fts disinfectants.db listN 'Surface_type' 'Active_ingredient' 'Risk_level' 'Date_on_List_N' 'Company' 'Contact_time' 'Use_site' 'Product_name' 'Formulation_type' 'Follow_directions_for_this_virus' 'Why_on_List_N' 'EPA_reg_num' --create-triggers --tokenize=porter

Update column order

  1. sqlite-utils transform disinfectants.db listN \
  2. --column-order EPA_reg_num \
  3. --column-order Risk_level \
  4. --column-order Active_ingredient \
  5. --column-order Product_name \
  6. --column-order Company \
  7. --column-order Use_site \
  8. --column-order Surface_type \
  9. --column-order Contact_time \
  10. --column-order Formulation_type \
  11. --column-order Follow_directions_for_this_virus \
  12. --column-order Date_on_List_N \
  13. --column-order Why_on_List_N \
  14. --column-order ID

Publish locally

  1. datasette disinfectants.db -m metadata.json --setting default_page_size 2000 --setting max_returned_rows 3000 --setting default_facet_size 35 --static static:static/ --template-dir templates/ --plugins-dir plugins -p 8001 -o
  1. datasette disinfectants.db -m metadata.json \
  2. --setting default_page_size 3000 \
  3. --setting max_returned_rows 3000 \
  4. --setting default_facet_size 35 -o \
  5. --static static:static/ \
  6. --template-dir templates/ \
  7. --plugins-dir plugins

Publish to Vercel

Visit: https://vercel.com/download to get CLI tool.

Run: vercel login to login to Vercel, then you can do this:

  1. datasette publish vercel disinfectants.db --project "list-n" --title "Disinfectants Used for Addressing COVID" --source "List N Tool COVID-19 Disinfectants" --source_url "https://cfpub.epa.gov/giwiz/disinfectants/index.cfm" --install datasette-vega --static static:static/ --metadata metadata.json --setting default_page_size 3000 --setting max_returned_rows 3000 --setting default_facet_size 35 --template-dir templates --plugins-dir plugins
  1. datasette publish vercel disinfectants.db \
  2. --project "list-n" \
  3. --title "Disinfectants Used for Addressing COVID" \
  4. --source "List N Tool COVID-19 Disinfectants" \
  5. --source_url "https://cfpub.epa.gov/giwiz/disinfectants/index.cfm" \
  6. --install datasette-vega \
  7. --setting default_page_size 3000 \
  8. --setting max_returned_rows 3000 \
  9. --setting default_facet_size 35 \
  10. --static static:static/ \
  11. --template-dir templates/
  12. --plugins-dir plugins/
  13. --metadata metadata.json \

Utilities and Miscellaneous

  1. sqlite-utils tables disinfectants.db --counts --columns
  2. sqlite-utils analyze-tables disinfectants.db listN
  3. sqlite-utils disable-fts disinfectants.db listN
  4. open /Applications/DB\ Browser\ for\ SQLite.app disinfectants.db

Datasette Session Notes - https://docs.google.com/document/d/1f61st8AXtpXvjeHB3UlmUhSCG1Ddiwih9nr-nO8LTEY/edit

Margie’s original notes - https://docs.google.com/document/d/1RHv_Twe7gzUMcfAeHZ-RlVQU-ZwshpEalZ4NmF9-ISk/edit
Simon’s original notes - https://docs.google.com/document/d/1Ck4Gopt8ssumGUjH1TeqASvHpFAPBJpTpDE_bvf4bCI/edit

  1. sqlite> .schema listN
  2. CREATE TABLE [listN] (
  3. [EMER_PATH] TEXT,
  4. [REGI_NUM] TEXT,
  5. [INST_VIRUS] TEXT,
  6. [COMPANY] TEXT,
  7. [USE_SITE] TEXT,
  8. [CONT_TIME] FLOAT,
  9. [ACTI_ING] TEXT,
  10. [USE_SURF] TEXT,
  11. [COMPANY_URL] TEXT,
  12. [DATE_ON_LIST_N] TEXT,
  13. [FORM_TYPE] TEXT,
  14. [ID] INTEGER PRIMARY KEY,
  15. [PROD_NAME] TEXT
  16. );

Now:

  1. CREATE TABLE [listN] (
  2. [Surface_type] TEXT,
  3. [Active_ingredient] TEXT,
  4. [Risk_level] TEXT,
  5. [Date_on_List_N] TEXT,
  6. [Company] TEXT,
  7. [Contact_time] FLOAT,
  8. [Use_site] TEXT,
  9. [Product_name] TEXT,
  10. [Active_ingredient] TEXT,
  11. [Formulation_type] TEXT,
  12. [Follow_directions_for_this_virus] TEXT,
  13. [Why_on_List_N] TEXT,
  14. [ID] INTEGER PRIMARY KEY,
  15. [EPA_reg_num] TEXT
  16. );

Special URLs

Key documentation