110 Open source projects that are alternatives of or similar to web-scraping-101

App that scrapes the Footlocker website to construct URLs for upcoming sneaker releases and adds the shoe to your cart if it is available. Uses Python and Selenium Webdriver. *Chrome and Chromedriver must be installed and Chromedriver must be on main path

A Fast Broken Link Hijacker Tool written in Python

Creating Scrapy scrapers via the Django admin interface

Public, free to use, repository with diggers configs for scraping / extracting data from various e-commerce websites and online stores

Archive a reddit user's post history. Formatted overview of a profile, JSON containing every post, and picture downloads. Uses the pushshift API.

Create agents that monitor and act on your behalf. Your agents are standing by!

A python script to get class schedules on UFLA's SIG and convert to a .CSV file to use in Google Calendar

R语言爬虫；Python爬虫；rvest；Rcurl

Simple datasets and notebooks for data visualization, statistical analysis and modelling - with write-ups here: http://projectosyo.wix.com/datadoubleconfirm.

A python web scraper for public email lists.

🥫 The simple, fast, and modern web scraping library

Suck the InTernet

Take the hassle out of web scraping

a class that uses scraped proxies to make http GET/POST requests (Python requests)

Command line tool to download and extract data from HTML/XML pages or JSON-APIs, using CSS, XPath 3.0, XQuery 3.0, JSONiq or pattern matching. It can also create new or transformed XML/HTML/JSON documents.

A Smart, Automatic, Fast and Lightweight Web Scraper for Python

An R web crawler and scraper

Schedules tweets using TweetDeck

Script for checking changes in webpages

Scrape Instagram content and stories anonymously, using a new technique based on the har file (No Token + No public API).

ARGUS is an easy-to-use web scraping tool. The program is based on the Scrapy Python framework and is able to crawl a broad range of different websites. On the websites, ARGUS is able to perform tasks like scraping texts or collecting hyperlinks between websites. See: https://link.springer.com/article/10.1007/s11192-020-03726-9

An Artificial Intelligence Chat Bot and Service Provider written in Python and AIML.

Covid19 Data API (JSON) - LIVE

A Simple, LightWeight, Statically-Typed Python3 API wrapper for GogoAnime.

Let's you to access your FB account from the command line and returns various things number of unread notifications, messages or friend requests you have.

Torrent Api ✨

Make a ZIM file from any Web site and surf offline!

Download all the ebooks with indexed csv of "allitebooks.com"

Scrape your favorite Anime from Okanime.com without effort

CLI program that collects information from facebook user profiles via Selenium.

Phomber is infomation grathering tool that reverse search phone numbers and get their details, written in python3.

bingip2hosts is a Bing.com web scraper that discovers websites by IP address

🗽 NY Times is an Minimal News 🗞 iOS app 📱 built to describe the use of SwiftSoup and CoreData with SwiftUI🔥

Physical Bitcoin Stat Ticker

Web scraper project to collect the useful Hong Kong weather data from HKO website

Python wrapper for the unofficial scraped API of the satori testing system.

단 몇줄의 코드로 다양한 쇼핑 플랫폼에서 결제 내역을 긁어오자!

PHP Metacritic API - Mirrored by my GitLab

a work-in-progress guide to web scraping as an artistic and critical practice

An image scraper that scraps images from unsplash.com

API for fetching data from news websites.

Colossus Repository for Kodi Addons - Kodi is a registered trademark of the XBMC Foundation. We are not connected to or in any other way affiliated with Kodi - DMCA: [email protected]

News extraction and scraping. Article Parsing

A web crawler that uses Firefox and js injection to interact with webpages and crawl their content, written in nodejs.

Android Web Scraper is a simple library for android web automation. You can perform web task in background to fetch website data programmatically.

Blog do Brasil.IO

Projeto de calculo de Imposto de Renda em operacoes na bovespa automaticamente. Tags:canal eletronico do investidor, CEI, selenium, bovespa, IRPF, IR, imposto de renda, finance, yahoo finance, acao, fii, etf, python, crawler, webscraping, calculadora ir

CHeSF is the Chrome Headless Scraping Framework, a very very alpha code to scrape javascript intensive web pages

This repo contains regression and classification projects. Examples: development of predictive models for comments on social media websites; building classifiers to predict outcomes in sports competitions; churn analysis; prediction of clicks on online ads; analysis of the opioids crisis and an analysis of retail store expansion strategies using…

State of the art object detection in real-time using YOLOV3 algorithm. Augmented with a process that allows easy training of the classifier as a plug & play solution . Provides alert if an item in an alert list is detected.