socks5 listAuto-updated SOCKS5 proxy list + proxies for Telegram
Stars: ✭ 210 (+4.48%)
RandomProxyRubyTiny Library for get random proxy (free).
Stars: ✭ 16 (-92.04%)
torchestratorSpin up Tor containers and then proxy HTTP requests via these Tor instances
Stars: ✭ 32 (-84.08%)
proxy fetcher💪 Ruby / JRuby / TrufflleRuby gem & CLI for dealing with proxy lists from various sources
Stars: ✭ 119 (-40.8%)
ProxyGrabAsynchronous Library made using Python and aiohttp to get proxies from multiple services!
Stars: ✭ 17 (-91.54%)
Proxy ScraperProxy-Scraper is simple Perl script for scraping proxies from multiple websites.
Stars: ✭ 24 (-88.06%)
Awesome Web ScrapingList of libraries, tools and APIs for web scraping and data processing.
Stars: ✭ 4,510 (+2143.78%)
Proxy ScraperLibrary for scraping free proxies lists
Stars: ✭ 78 (-61.19%)
Instagram CrawlerCrawl instagram photos, posts and videos for download.
Stars: ✭ 178 (-11.44%)
Goose ParserUniversal scrapping tool, which allows you to extract data using multiple environments
Stars: ✭ 211 (+4.98%)
Scrape Twitter🐦 Access Twitter data without an API key. [DEPRECATED]
Stars: ✭ 166 (-17.41%)
Scrapysharpreborn of https://bitbucket.org/rflechner/scrapysharp
Stars: ✭ 226 (+12.44%)
ReadablewebproxyRewriting web proxy and archival tool. At this point, it just tries to download all the things.
Stars: ✭ 172 (-14.43%)
TwitterScraperScrape a User's Twitter data! Bypass the 3,200 tweet API limit for a User!
Stars: ✭ 80 (-60.2%)
Tianyanchapip安装的天眼查爬虫API,指定的单个/多个企业工商信息一键保存为Excel/JSON格式。A Battery-included Scraper API of Tianyancha, the best Chinese business data and investigation platform.
Stars: ✭ 206 (+2.49%)
Datmusic ApiAlternative for VK Audio API
Stars: ✭ 160 (-20.4%)
Covid19 mobilityCOVID-19 Mobility Data Aggregator. Scraper of Google, Apple, Waze and TomTom COVID-19 Mobility Reports🚶🚘🚉
Stars: ✭ 156 (-22.39%)
DemeterDemeter is a tool for scraping the calibre web ui
Stars: ✭ 155 (-22.89%)
TradeTheEventImplementation of "Trade the Event: Corporate Events Detection for News-Based Event-Driven Trading." In Findings of ACL2021
Stars: ✭ 64 (-68.16%)
Heroku ebooksA script to generate Markov chains and to post to an _ebooks account on Twitter using Heroku
Stars: ✭ 251 (+24.88%)
Weibo terminaterFinal Weibo Crawler Scrap Anything From Weibo, comments, weibo contents, followers, anything. The Terminator
Stars: ✭ 2,295 (+1041.79%)
Scraperwiki PythonScraperWiki Python library for scraping and saving data
Stars: ✭ 146 (-27.36%)
Jsonframe Cheeriosimple multi-level scraper json input/output for Cheerio
Stars: ✭ 196 (-2.49%)
Youtube ProjectsThis repository contains all the code I use in my YouTube tutorials.
Stars: ✭ 144 (-28.36%)
GmdbGMDB is the ultra-simple, cross-platform Movie Library with Features (Search, Take Note, Watch Later, Like, Import, Learn, Instantly Torrent Magnet Watch)
Stars: ✭ 189 (-5.97%)
Annie👾 Fast and simple video download library and CLI tool written in Go
Stars: ✭ 16,369 (+8043.78%)
Unhtml.rsA magic html parser
Stars: ✭ 180 (-10.45%)
Linkedin Profile Scraper🕵️♂️ LinkedIn profile scraper returning structured profile data in JSON. Works in 2020.
Stars: ✭ 171 (-14.93%)
Ruiji.netcrawler framework, distributed crawler extractor
Stars: ✭ 220 (+9.45%)
Novel基于 Laravel 5.2 的小说网站
Stars: ✭ 172 (-14.43%)
yellowpages-scraperYellowpages.com Web Scraper written in Python and LXML to extract business details available based on a particular category and location.
Stars: ✭ 56 (-72.14%)
Scrapelib⛏ a library for scraping things
Stars: ✭ 164 (-18.41%)
Media ScraperScrapes all photos and videos in a web page / Instagram / Twitter / Tumblr / Reddit / pixiv / TikTok
Stars: ✭ 206 (+2.49%)
OpensanctionsAn open database of international sanctions data, persons of interest and politically exposed persons
Stars: ✭ 157 (-21.89%)
PoliteBe nice on the web
Stars: ✭ 253 (+25.87%)
Instagram Scraperscrapes medias, likes, followers, tags and all metadata. Inspired by instagram-php-scraper,bot
Stars: ✭ 2,209 (+999%)
CollyElegant Scraper and Crawler Framework for Golang
Stars: ✭ 15,535 (+7628.86%)
SerpscrapSEO python scraper to extract data from major searchengine result pages. Extract data like url, title, snippet, richsnippet and the type from searchresults for given keywords. Detect Ads or make automated screenshots. You can also fetch text content of urls provided in searchresults or by your own. It's usefull for SEO and business related research tasks.
Stars: ✭ 153 (-23.88%)
scrapetubeGet all videos from a youtube channel, get all videos from a playlist, get all videos that match a search
Stars: ✭ 120 (-40.3%)
PhpscraperPHP Scraper - an highly opinionated web-interface for PHP
Stars: ✭ 148 (-26.37%)
Querylist🕷️ The progressive PHP crawler framework! 优雅的渐进式PHP采集框架。
Stars: ✭ 2,392 (+1090.05%)
Google2csvGoogle2Csv a simple google scraper that saves the results on a csv/xlsx/jsonl file
Stars: ✭ 145 (-27.86%)
JvppeteerHeadless Chrome For Java (Java 爬虫)
Stars: ✭ 193 (-3.98%)
Google Play ScraperGoogle play scraper for Python inspired by <facundoolano/google-play-scraper>
Stars: ✭ 143 (-28.86%)
ZillowZillow Scraper for Python using Selenium
Stars: ✭ 141 (-29.85%)
Go Jd京东自动登录,在线商品自动下单
Stars: ✭ 139 (-30.85%)
MangDLThe most inefficient Manga downloader for PC
Stars: ✭ 40 (-80.1%)
Scrape Linkedin Selenium`scrape_linkedin` is a python package that allows you to scrape personal LinkedIn profiles & company pages - turning the data into structured json.
Stars: ✭ 239 (+18.91%)
Node Ytdl CoreYouTube video downloader in javascript.
Stars: ✭ 3,004 (+1394.53%)
OnegramThis repository is no longer maintained.
Stars: ✭ 137 (-31.84%)
UnfurlScraper for oEmbed, Twitter Cards and Open Graph metadata - fast and Promise-based ⚡️
Stars: ✭ 193 (-3.98%)
UdemycoursegrabberYour will to enroll in Udemy course is here, but the money isn't? Search no more! This python program searches for your desired course in more than [insert big number here] websites, compares the last updated date, and gives you the download link of the latest one back, but you also have the choice to see the other ones as well!
Stars: ✭ 137 (-31.84%)
NewspaperNews, full-text, and article metadata extraction in Python 3. Advanced docs:
Stars: ✭ 11,545 (+5643.78%)
GetsyA simple browser/client-side web scraper.
Stars: ✭ 238 (+18.41%)
Thepiratebay💀 The Pirate Bay node.js client
Stars: ✭ 191 (-4.98%)