418 Open source projects that are alternatives of or similar to Proxy Scraper

Distributed crawler powered by Headless Chrome

An Unofficial Pitchfork Music API client for Node.js

A Facebook crawler

Fetches PubMed article IDs (PMIDs) from email inbox, then crawls PubMed, Google Scholar and Sci-Hub for respective PDF files.

Unofficial MyAnimeList PHP+REST API which provides functions other than the official API

🎶 Unofficial python API for pitchfork.com reviews.

Scrapes Reddit to download media of your choice.

online port scan scraper

Unofficial API for finviz.com

Tổng hợp script crawl dữ liệu từ các mạng xã hội & website tiếng Việt

Declarative web scraping

A scrapy spider that scraps times and prices from Voyages Sncf. It uses scrapyrt to provide an API interface.

Extract structured data from web sites. Web sites scraping.

Golang pkg to quickly return a preview of a webpage (title/description/images)

Crawl BookCorpus

Scraping scripts for various websites.

A social networking service scraper in Python

Kodi Bae Repository - Kodi is a registered trademark of the XBMC Foundation. We are not connected to or in any other way affiliated with Kodi - DMCA: [email protected]

A library that scrapes Linkedin for user data

👁 Bulk-download all thumbnails from an ImageNet synset, with optional rescaling

Distributed Scraper

The Zipru scraper developed in the Advanced Web Scraping Tutorial.

package to scrape www.brainly.co.id

🔮 A Node.js scraper for humans.

Tool to fetch Instagram's public content.

A list of scrapers from around the web.

Download .torrent files from YTS YIFY

A Python Tool For google Hacking

An API to easily get data from the University of Pittsburgh

Fresh Onions is an open source TOR spider / hidden service onion crawler hosted at zlal32teyptf4tvi.onion

A news scraper for nodejs that help to scrap news from Indonesian news portal.

Command line tool to download and extract data from HTML/XML pages or JSON-APIs, using CSS, XPath 3.0, XQuery 3.0, JSONiq or pattern matching. It can also create new or transformed XML/HTML/JSON documents.

📙 中华新华字典数据库。包括歇后语，成语，词语，汉字。

A Smart, Automatic, Fast and Lightweight Web Scraper for Python

📈 Create GIFs from user's GitHub activity graph

Linkedin Scraper using Selenium Web Driver, Chromium headless, Docker and Scrapy

🐙 Get Daily 400-500 Real Followers 👽 [BadRobo] is Best Instagram Bot Available Now with All Features!. Our BOT did not violate any of Instagram's rules, so you don't have to worry about getting ACTION BLOCK!

An extremely fast web scraper that parses megabytes of invalid HTML in a blink of an eye. PHP5.3+, no dependencies.

An unofficial DuckDuckGo search API.

Ruby gem to inspect completely a web page. It scrapes a given URL, and returns you its meta, links, images more.

Google Search SERP Scraper

An R web crawler and scraper

[Unmaintained] A simple and clean video/music/image downloader 👾

🍭 epub generator for (light)novels (轻) 小说 epub 生成器，支持站点：轻之国度、轻小说文库

Kotlin/Java library and cli tool for scraping posts and media from various sources with neither authorization nor full page rendering (Facebook, Instagram, Twitter, Youtube, Tiktok, Telegram, Twitch, Reddit, 9GAG, Pinterest, Flickr, Tumblr, IFunny, VK, Pikabu)

A Simple Proxy Scraper

proxylist, generate by fate0/getproxy project in every 15 minute

我的爬虫合集

Web scraper that makes it easier to find real estate in Slovenia.

Extracting data of Nepal Stock Exchange Ltd. (NEPSE)

Scrape all the media from an OnlyFans account - Updated regularly

A content downloader, capable of retrieving works of (fan)fiction from the web and saving them in a few common file formats.

Tangerine Bank scraper

HTTP API for Scrapy spiders

Declarative DOM extraction expression evaluator. 👨‍⚕️

🚀 A fast and lightweight utility and Python library for downloading posts, stories, and highlights from Instagram.

Python3 API wrapper and web scraper for https://coinmarketcap.com

Web scraper that can create an offline readable version of a website

Intuitive timetable builder for the Australian National University.

A Node.js wrapper for scraping allrecipes.com