1108 Open source projects that are alternatives of or similar to TorScrapper

A Python Tool For google Hacking

🕸 List of mini projects that involve web scraping 🕸

Papercut is a scraping/crawling library for Node.js built on top of JSDOM. It provides basic selector features together with features like Page Caching and Geosearch.

`scrape_linkedin` is a python package that allows you to scrape personal LinkedIn profiles & company pages - turning the data into structured json.

Pahe.ph [Pahe.in] Movies Website Scraper

Distributed crawler powered by Headless Chrome

🎶 Unofficial python API for pitchfork.com reviews.

Anime-dl is a command-line program to download anime from CrunchyRoll and Funimation.

simple multi-level scraper json input/output for Cheerio

scrapers for building your own image databases

Home Assistant custom component for scraping (html, xml or json) multiple values (from a single HTTP request) with a separate sensor/attribute for each value. Support for (login) form-submit functionality.

ProxyCrawl Python library for scraping and crawling

Crawly, a high-level web crawling & scraping framework for Elixir.

Extract structured data from web sites. Web sites scraping.

Creating Scrapy scrapers via the Django admin interface

✂️ High performance, multi-threaded image scraper

PHP Scraper - an highly opinionated web-interface for PHP

SEO python scraper to extract data from major searchengine result pages. Extract data like url, title, snippet, richsnippet and the type from searchresults for given keywords. Detect Ads or make automated screenshots. You can also fetch text content of urls provided in searchresults or by your own. It's usefull for SEO and business related research tasks.

reborn of https://bitbucket.org/rflechner/scrapysharp

Geziyor, a fast web crawling & scraping framework for Go. Supports JS rendering.

Tool to scrape linkedin

爬虫工程师常用的 Chrome 插件 | Chrome extensions used by crawler developer

Retrieve real (with Javascript executed) HTML code from an URL, ultra fast and supports multiple parallel loading of webs

🌎 🏨 Scrape Booking.com 🏨 🌎

Collection of scrapy spiders which can scrape posts, images, and so on from public Facebook Pages.

Command line program to download documents from web portals.

A repository to store Deep Web (onion domain) crawler, scraper, and NLP tools for Tor network.

Fresh Onions is an open source TOR spider / hidden service onion crawler hosted at zlal32teyptf4tvi.onion

Declarative web scraping

A Smart, Automatic, Fast and Lightweight Web Scraper for Python

Search for and retrieve US Patent and Trademark Office Patent Data

[Unmaintained] A simple and clean video/music/image downloader 👾

The main functionality is to extract all the emails from one or several URLs - La funcionalidad principal es extraer todos los correos electrónicos de una o varias Url

Linkedin Scraper using Selenium Web Driver, Chromium headless, Docker and Scrapy

Your will to enroll in Udemy course is here, but the money isn't? Search no more! This python program searches for your desired course in more than [insert big number here] websites, compares the last updated date, and gives you the download link of the latest one back, but you also have the choice to see the other ones as well!

An example using Selenium webdrivers for python and Scrapy framework to create a web scraper to crawl an ASP site

🕵️‍♂️ LinkedIn profile scraper returning structured profile data in JSON. Works in 2020.

Scrape job websites into a single spreadsheet with no duplicates.

Universal scrapping tool, which allows you to extract data using multiple environments

Elegant Scraper and Crawler Framework for Golang

This class can retrieve search results from Google.

A collection of tools to (semi-)automatically collect and analyze data from online discussions on Facebook groups and pages.

Chopper is a tool to extract elements from HTML by preserving ancestors and CSS rules

Wikipedia API wrapper for references

**[ARCHIVED]** website changes tracker 🔍

⚽ Instantly find 🏆EURO 2016 live-streams & highlights, now a Web App!

extract data from html table

[Deprecated - Maintenance mode - use APIs directly please!] The official Diffbot client library

Monitor instagram user account and automatically post new images to discord channel via a webhook. Working 2022!

Basic setup with random user agents and IP addresses for Python Scrapy Framework.

Wget-AT is a modern Wget with Lua hooks, Zstandard (+dictionary) WARC compression and URL-agnostic deduplication.

No description or website provided.

All-in-one Python (And now Go!) module to help solve captchas with Capmonster, 2captcha and Anticaptcha API's!

Spin up Tor containers and then proxy HTTP requests via these Tor instances

Nodejs web scraper. Contains a command line, docker container, terraform module and ansible roles for distributed cloud scraping. Supported databases: SQLite, MySQL, PostgreSQL. Supported headless clients: Puppeteer, Playwright, Cheerio, JSdom.

No description or website provided.

OnionFruit™ Connect - Tor access client with country selection, bridge configuration, pluggable transports and experimental DNS support

A PHP Scraping Class

A tutorial-based introduction to web scraping with Python.

Scraping the status of WhatsApp contacts