990 Open source projects that are alternatives of or similar to Udemycoursegrabber

An example using Selenium webdrivers for python and Scrapy framework to create a web scraper to crawl an ASP site

`scrape_linkedin` is a python package that allows you to scrape personal LinkedIn profiles & company pages - turning the data into structured json.

No description or website provided.

No description or website provided.

Retrieve real (with Javascript executed) HTML code from an URL, ultra fast and supports multiple parallel loading of webs

Simple and friendly Bot for Instagram, using Selenium and Scrapy with Python.

A tutorial-based introduction to web scraping with Python.

🕸 List of mini projects that involve web scraping 🕸

A Scraper made 100% in Python using BeautifulSoup and Tor. It can be used to scrape both normal and onion links. Happy Scraping :)

Nodejs web scraper. Contains a command line, docker container, terraform module and ansible roles for distributed cloud scraping. Supported databases: SQLite, MySQL, PostgreSQL. Supported headless clients: Puppeteer, Playwright, Cheerio, JSdom.

A Python Tool For google Hacking

Automated Tinder bot and scraper using selenium in python.

The simplest demo of chrome automation by python and selenium in AWS Lambda

ProxyCrawl Python library for scraping and crawling

Download public videos on TikTok using Python with Selenium

Command line program to download documents from web portals.

All-in-one Python (And now Go!) module to help solve captchas with Capmonster, 2captcha and Anticaptcha API's!

Papercut is a scraping/crawling library for Node.js built on top of JSDOM. It provides basic selector features together with features like Page Caching and Geosearch.

Wget-AT is a modern Wget with Lua hooks, Zstandard (+dictionary) WARC compression and URL-agnostic deduplication.

Generate Free Edu Mail(s) within minutes

Linkedin Scraper using Selenium Web Driver, Chromium headless, Docker and Scrapy

Build and deploy a machine learning app from scratch 🚀

Extract structured data from web sites. Web sites scraping.

Declarative web scraping

✂️ High performance, multi-threaded image scraper

Creating Scrapy scrapers via the Django admin interface

[Deprecated - Maintenance mode - use APIs directly please!] The official Diffbot client library

With Selenium headless browsing and CAPTCHA solving

An Instagram Scrapper

The main functionality is to extract all the emails from one or several URLs - La funcionalidad principal es extraer todos los correos electrónicos de una o varias Url

Scraping Visually Similar Images from Pinterest

Monitor instagram user account and automatically post new images to discord channel via a webhook. Working 2022!

Home Assistant custom component for scraping (html, xml or json) multiple values (from a single HTTP request) with a separate sensor/attribute for each value. Support for (login) form-submit functionality.

A PHP Scraping Class

scrapers for building your own image databases

CHeSF is the Chrome Headless Scraping Framework, a very very alpha code to scrape javascript intensive web pages

Create and **automatically** update a list of all videos on a YouTube channel (in txt/csv/md form) via YouTube bot with end-to-end web scraping - no API tokens required. Multi-threaded support for YouTube videos list updates.

Instagram comment scraper using python and selenium. Save the comments into excel.

No description or website provided.

Scraping the status of WhatsApp contacts

Collection of scrapy spiders which can scrape posts, images, and so on from public Facebook Pages.

A Scraper, Downloader, & Recorder for static open directories.

**[ARCHIVED]** website changes tracker 🔍

Schedules tweets using TweetDeck

Scrape Instagram content and stories anonymously, using a new technique based on the har file (No Token + No public API).

A Smart, Automatic, Fast and Lightweight Web Scraper for Python

A course downloader/scrapper for https://www.pluralsight.com

Crawly, a high-level web crawling & scraping framework for Elixir.

Custom Selenium Chromedriver | Zero-Config | Passes ALL bot mitigation systems (like Distil / Imperva/ Datadadome / CloudFlare IUAM)

Distributed crawler powered by Headless Chrome

A collection of tools to (semi-)automatically collect and analyze data from online discussions on Facebook groups and pages.

Messenger Bot that scrapes for COVID-19 data and periodically updates subscribers via Facebook Messages. Created using Python/Flask, MYSQL, HTML, Heroku

Search for and retrieve US Patent and Trademark Office Patent Data

Social media research and promotion, semi-autonomous CLI bot

Scrapping tool for GISAID data regarding SARS-CoV-2

Pahe.ph [Pahe.in] Movies Website Scraper

爬虫工程师常用的 Chrome 插件 | Chrome extensions used by crawler developer

An Instagram OSINT tool to collect all the geotagged locations available on an Instagram profile in order to plot them on a map, and dump them in a JSON.

[Unmaintained] A simple and clean video/music/image downloader 👾

Geziyor, a fast web crawling & scraping framework for Go. Supports JS rendering.