All Projects → COVID19Tracking → covid-data-pipeline

COVID19Tracking / covid-data-pipeline

Licence: Apache-2.0 license
Scan/Trim/Extra Pipeline for State Coronavirus Site

Programming Languages

python
139335 projects - #7 most used programming language

Projects that are alternatives of or similar to covid-data-pipeline

covid-tracking-dash
Dash app for COVID Tracking Project (https://covidtracking.com/)
Stars: ✭ 26 (+73.33%)
Mutual labels:  tooling, unused
analysis-flow
Data Analysis Workflows & Reproducibility Learning Resources
Stars: ✭ 108 (+620%)
Mutual labels:  tooling
Partyline
Output to Laravel's console from outside of your Command classes.
Stars: ✭ 168 (+1020%)
Mutual labels:  tooling
Go Tooling Workshop
A workshop covering all the tools gophers use in their day to day life
Stars: ✭ 2,683 (+17786.67%)
Mutual labels:  tooling
Tooling
🧰 Up-to-date list of JavaScript and TypeScript tooling resources
Stars: ✭ 181 (+1106.67%)
Mutual labels:  tooling
mix unused
Find unused functions in your project
Stars: ✭ 181 (+1106.67%)
Mutual labels:  unused
Openwhisk Devtools
Development tools for building and deploying Apache OpenWhisk
Stars: ✭ 141 (+840%)
Mutual labels:  tooling
fliphub
the easiest app builder
Stars: ✭ 30 (+100%)
Mutual labels:  tooling
docker-compose-laravel
A Docker Compose setup for Laravel projects.
Stars: ✭ 23 (+53.33%)
Mutual labels:  tooling
Bootboot
Dualboot your Ruby app made easy
Stars: ✭ 239 (+1493.33%)
Mutual labels:  tooling
Orchard
A fertile ground for Clojure tooling
Stars: ✭ 219 (+1360%)
Mutual labels:  tooling
Nix Index
Quickly locate nix packages with specific files
Stars: ✭ 197 (+1213.33%)
Mutual labels:  tooling
storybook-addon-props
React Storybook Addon to show component properties and stories into panels
Stars: ✭ 22 (+46.67%)
Mutual labels:  tooling
Front End Tooling Recipes
Collection of pre-configured front-end tooling setups for common uses.
Stars: ✭ 176 (+1073.33%)
Mutual labels:  tooling
deadfile
Simple util to find unused files in any JavaScript project (ES5, ES6, React, Vue, ...)
Stars: ✭ 259 (+1626.67%)
Mutual labels:  unused
Punk
A data REBL built for the web
Stars: ✭ 148 (+886.67%)
Mutual labels:  tooling
Profilinggo
A quick tour (or reminder) of Go performance tools
Stars: ✭ 219 (+1360%)
Mutual labels:  tooling
swift-watch
Watches over your Swift project's source
Stars: ✭ 43 (+186.67%)
Mutual labels:  tooling
s3-concat
Concatenate Amazon S3 files remotely using flexible patterns
Stars: ✭ 32 (+113.33%)
Mutual labels:  tooling
cljs-tooling
[DEPRECATED] Tooling support for ClojureScript
Stars: ✭ 58 (+286.67%)
Mutual labels:  tooling

corona19-data-pipeline

Scan/Trim/Extract Pipeline for Coronavirus Site

  • The code now expects to be run from the root directory of the repo. *
  • This includes IDEs like VS Code. *

Scanner

  1. Gets the data from urls in google sheet.
  2. Pulls the raw HTML
  3. Creates a clean version without the markup
  4. Push it into a github repo.

Backup To S3

  1. pulls an image for each page
  2. pushed it to an S3 bucket

Specialized_Capture

  1. Fire up a captive browser
  2. For a list of urls, take a screen shot
  3. If they change, push them into git
Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].