All Projects → mikepqr → real-estate-scrape-eg

mikepqr / real-estate-scrape-eg

Licence: other
A repository demonstrating the use of real-estate-scrape to store the estimated value of a property on Redfin and Zillow every night using Github Actions.

Projects that are alternatives of or similar to real-estate-scrape-eg

gh-action-data-scraping
this shows how to use github actions to do periodic data scraping
Stars: ✭ 147 (+716.67%)
Mutual labels:  git-scraping
sf-tree-history
Tracking the history of trees in San Francisco
Stars: ✭ 23 (+27.78%)
Mutual labels:  git-scraping
usps-collection-boxes
US Postal Service collection box locations.
Stars: ✭ 21 (+16.67%)
Mutual labels:  git-scraping
lfk.im
🍽 Lawrence, Kansas curbside takeout and delivery for local COVID-19 impacted businesses
Stars: ✭ 16 (-11.11%)
Mutual labels:  git-scraping
disaster-data
Data scraped by https://github.com/simonw/disaster-scrapers
Stars: ✭ 35 (+94.44%)
Mutual labels:  git-scraping
ark-invest-scraper
Pulling a history of the holdings for ark invest funds https://ark-funds.com/
Stars: ✭ 39 (+116.67%)
Mutual labels:  git-scraping
ca-fires-history
Tracking fire data from www.fire.ca.gov
Stars: ✭ 160 (+788.89%)
Mutual labels:  git-scraping
Nyt 2020 Election Scraper
alex.github.io/nyt-2020-election-scraper/battleground-state-changes.html
Stars: ✭ 1,782 (+9800%)
Mutual labels:  git-scraping
berlin corona cases
Scraper for the official dashboard with current Corona case numbers, traffic light indicators ("Corona-Ampel") and vaccination situation for Berlin.
Stars: ✭ 19 (+5.56%)
Mutual labels:  git-scraping
nepse-tracker
Track new investment opportunities in Nepal and add them to my to-do list.
Stars: ✭ 19 (+5.56%)
Mutual labels:  git-scraping

real-estate-scrape example

A repository demonstrating the use of real-estate-scrape to store the estimated value of a property on Redfin and Zillow every night using Github Actions.

Plot of Redfin and Zillow valuation as a function of time

See data.csv and data.png (above) for example output for 594 S Mapleton Dr, Los Angeles (not my house!)

Note: this house happens to have been on the market since February 2022, which means Redfin is refusing to generate an estimate for it. The Zillow estimate is recorded successfully, but the workflow is marked as failing because we don't get both estimates. The Redfin estimate will presumably return when the house is sold.

Automated usage

  1. Sign up for scraperapi and make a note of your API key. The free account is enough to get started.

  2. Make a copy of this repository, e.g. using the template.

  3. Commit changes deleting data.csv and data.png.

  4. Under Settings > Secrets, configure environment variables containing the URLs of the address on Redfin and Zillow and your ScraperBox key:

    • REDFIN_URL, e.g. https://www.redfin.com/CA/Los-Angeles/594-S-Mapleton-Dr-90024/home/6824711
    • ZILLOW_URL, e.g. https://www.zillow.com/homedetails/594-S-Mapleton-Dr-Los-Angeles-CA-90024/20524417_zpid/
    • SCRAPERAPI_KEY, e.g.abcdefqwert12345

The scraping job runs every day at 5am UTC. Come back in 24 hours and you should find data.csv in your repository. Come back a few days later and you should see the beginnings of a chart in data.png.

Alternatively, you can run the scraping job manually as often as you like by clicking "Run workflow" under Actions > scrape on GitHub.

Advanced/manual usage

See real-estate-scrape.

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].