GitPlanet

Cheap and reliable Node.js hosting starts at $3/month, and $1/month static HTML hosting

Created with love in Canada, visit hostnodejs.com today

Feel like to post an Ad? Learn Details
All Projects → WillNye → deal_scraper

WillNye / deal_scraper

Licence: other
Find local deals at Walmart and Target

Programming Languages

python
139335 projects - #7 most used programming language
shell
77523 projects

Deal Scraper

NOTE - You need a proxy or you will get IP Banned. I've had success with https://myiphide.com/

Pulls local inventory from the trending deals by category and/or Brand to get a single, easy to use page with price drop detection and discount thresholds

Getting Started

  • You need python 3.5+
  • Go to docker_eck and follow the steps to getting the backend and UI running to display the deal
  • Run pip install -r requirements.txt
  • Setup your host with python cli.py setup --proxy YourProxyIPandPortGoesHere --zip_code YourZip
  • python cli.py deals --filter Lego --page 1 to start scanning for deals

Tips

  • Retrieve a new proxy for each request, it seems like you get stale results after batch submission

License

It's a public repo, do whatever.

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].