696 Open source projects that are alternatives of or similar to Advanced Web Scraping Tutorial

The main functionality is to extract all the emails from one or several URLs - La funcionalidad principal es extraer todos los correos electrónicos de una o varias Url

Linkedin Scraper using Selenium Web Driver, Chromium headless, Docker and Scrapy

An open source webapp for scraping: towards a public service for webscraping

Indonesia Index News Crawler, including 10 online media

A scrapy spider that scraps times and prices from Voyages Sncf. It uses scrapyrt to provide an API interface.

crawler framework, distributed crawler extractor

[Crawler/Scraper for Golang]🕷A lightweight distributed friendly Golang crawler framework.一个轻量的分布式友好的 Golang 爬虫框架。

A Facebook crawler

Scrapoxy hides your scraper behind a cloud. It starts a pool of proxies to send your requests. Now, you can crawl without thinking about blacklisting!

HTTP API for Scrapy spiders

A python web scraper for public email lists.

Araignée LeBonCoin avec Scrapy et ElasticSearch

An example using Selenium webdrivers for python and Scrapy framework to create a web scraper to crawl an ASP site

Creating Scrapy scrapers via the Django admin interface

📻 An OLX Scraper using Scrapy + MongoDB. It Scrapes recent ads posted regarding requested product and dumps to NOSQL MONGODB.

Collection of scrapy spiders which can scrape posts, images, and so on from public Facebook Pages.

百度贴吧爬虫(基于scrapy和mysql)

Convolutional neural networks for artistic style transfer.

🍭 epub generator for (light)novels (轻) 小说 epub 生成器，支持站点：轻之国度、轻小说文库

TripAdvisor scraper

A curated list of awesome packages, articles, and other cool resources from the Scrapy community.

A Smart, Automatic, Fast and Lightweight Web Scraper for Python

Stream anime from kaa.si and sync with anilist

Simple Weibo Scraper

Extracting data of Nepal Stock Exchange Ltd. (NEPSE)

Uno Crawler por https://douban.com

Update Version of weibo_terminator, This is Workflow Version aim at Get Job Done!

Command line tool to download and extract data from HTML/XML pages or JSON-APIs, using CSS, XPath 3.0, XQuery 3.0, JSONiq or pattern matching. It can also create new or transformed XML/HTML/JSON documents.

JavaFX 3D Development Tutorial

Build and deploy a machine learning app from scratch 🚀

Scrape a Facebook profile and turn it into a JSON file

JavGo是一个集合影片管理，影片刮削，视频处理，资源搜索等综合一体的全功能影音软件，支持爬取javbus，jav321，javdb，javlibrary进行刮削，支持db，bus的磁力搜索，支持获取library的影片评论。

A Simple Proxy Scraper

NLP in Python with Deep Learning

我的爬虫合集

🎊 Design and implement of lightweight crawler framework.

A Python Tool For google Hacking

Scrape Instagram content and stories anonymously, using a new technique based on the har file (No Token + No public API).

Generating spiders dynamically to crawl and check those free proxy ip on the internet with scrapy.

Cryptocurrency historical price data library in Python. Data from https://coinmarketcap.com.

🔮 A Node.js scraper for humans.

A content downloader, capable of retrieving works of (fan)fiction from the web and saving them in a few common file formats.

A tiny Node.js microservice to scrape open graph data with joy.

The repo contains the source code for all the tutorials on the FilledStacks Youtube channel.

An extremely fast web scraper that parses megabytes of invalid HTML in a blink of an eye. PHP5.3+, no dependencies.

Aiohttp web server API, which scrapes Google and returns scrape results as response. Supports proxies, multiple geos and number of results.

A course downloader/scrapper for https://www.pluralsight.com

🤖 👻 Desktop application for Instagram Bot, Twitter Bot and Facebook Bot

A collection of tools to (semi-)automatically collect and analyze data from online discussions on Facebook groups and pages.

Scraper example built on Scala, Akka and Jsoup

Fresh Onions is an open source TOR spider / hidden service onion crawler hosted at zlal32teyptf4tvi.onion

Ruby gem to inspect completely a web page. It scrapes a given URL, and returns you its meta, links, images more.

Non-official Python wrapper and CLI tool for Trainline

python-Reptile

Crawlera middleware for Scrapy

PTT 圖片下載器 (抓取整個看板的圖片，並用文章標題作為資料夾的名稱 ) (使用Scrapy)

ARGUS is an easy-to-use web scraping tool. The program is based on the Scrapy Python framework and is able to crawl a broad range of different websites. On the websites, ARGUS is able to perform tasks like scraping texts or collecting hyperlinks between websites. See: https://link.springer.com/article/10.1007/s11192-020-03726-9

A list of scrapers from around the web.

swiss army knife for hackers

Generative Models Tutorial with Demo: Bayesian Classifier Sampling, Variational Auto Encoder (VAE), Generative Adversial Networks (GANs), Popular GANs Architectures, Auto-Regressive Models, Important Generative Model Papers, Courses, etc..