110 Open source projects that are alternatives of or similar to Webscrapping

Web Scraping Framework

Helpful Selenium functions to make web-scraping easier and faster

Sometimes we need to scrap web data from our Android App. To achieve this goal jsoup library is a good option. I wrote a blog post on this topic in my personal blog. If you know Bengali language then you can visit this link.

Animeflv is a custom API that has the entire catalog of the animeflv.net website. You can enjoy all the content with subtitles in Spanish and the latest in the world of anime for free.

Scrap Medium Articles using tags.

🌎 🏨 Scrape Booking.com 🏨 🌎

Automated Python Script to retrieve vaccine slots availability and get notified when a slot is available.

[really old and probably doesn't work] Slack bot to post relevant Toronto apartment listings from Kijiji & Craigslist

Application for extracting large amounts of data from the Google search results page

A program which takes an Anime name or URL and downloads the specified range of episodes.

SerpApi client library for Node.js. Previously: Google Search Results Node.js.

A library to get images from social media

📚 A GoodReads.com Scraper script to get books reviews including text and rating.

Rotate between different NordVPN servers with ease. Works both on Linux and Windows without any required changes to your code!

🔍 Data pipeline for crawling PDFs from the Web and transforming their contents into structured data using AWS textract. Built with AWS CDK + TypeScript

Be nice on the web

🗽 A Simple Demonstration of the New York Times App 📱 using Jsoup web crawler with MVVM Architecture 🔥

LinkedIn enumeration tool to extract valid employee names from an organization through search engine scraping

Guide, reference and cheatsheet on web scraping using rvest, httr and Rselenium.

Extract price and indicator data from TradingView charts to create ML datasets

Powerful and flexible Instagram scraping library for Python, providing easy-to-use and expressive tools for accessing data programmatically

Open Source web scraping API. Falkor turns web pages into queryable JSON

📲 Bot to help solve HQ trivia

An extensible API for breaking captchas

This repository contains all the code I use in my YouTube tutorials.

Github stargazers information gathering tool

A TikTokBot that downloads trending tiktok videos and compiles them using FFmpeg

ralger makes it easy to scrape a website. Built on the shoulders of titans: rvest, xml2.

operating systems three easy pieces by Rezmi

🎬 A Crunchyroll show/season ripper

Web Scraper in Go, similar to BeautifulSoup

Scrapes g4g and creates PDF

A php crawler that finds emails on the internets

An exploration of New York Times crossword answers from 1994-2017, i.e. the Will Shortz era.

Code for the second edition Web Scraping with Python book by Packt Publications

DotnetCrawler is a straightforward, lightweight web crawling/scrapying library for Entity Framework Core output based on dotnet core. This library designed like other strong crawler libraries like WebMagic and Scrapy but for enabling extandable your custom requirements. Medium link : https://medium.com/@mehmetozkaya/creating-custom-web-crawler-with-dotnet-core-using-entity-framework-core-ec8d23f0ca7c

Perceptual image hashing for Node.js

An automation bot for free Udemy courses

可视化任务调度系统，精简到一个二进制文件 (Web visual task scheduler system , yes ! just one binary solve all the problems !)

This repository contains data and code used to get and clean data from https://github.com/CSSEGISandData/COVID-19 and https://www.worldometers.info/coronavirus/

Download/access photos, videos, stories, story highlights, postlives, following and followers of Instagram

Nunux Keeper core API

Web-scraping script that writes the data of all players from FutHead and FutBin to a CSV file or a DB

App that scrapes the Footlocker website to construct URLs for upcoming sneaker releases and adds the shoe to your cart if it is available. Uses Python and Selenium Webdriver. *Chrome and Chromedriver must be installed and Chromedriver must be on main path

A Fast Broken Link Hijacker Tool written in Python

Creating Scrapy scrapers via the Django admin interface

Public, free to use, repository with diggers configs for scraping / extracting data from various e-commerce websites and online stores

Archive a reddit user's post history. Formatted overview of a profile, JSON containing every post, and picture downloads. Uses the pushshift API.

Create agents that monitor and act on your behalf. Your agents are standing by!

A python script to get class schedules on UFLA's SIG and convert to a .CSV file to use in Google Calendar