unfurlExtract rich metadata from URLs
Stars: ✭ 41 (+64%)
trawlerscraper for facebook, gab, google and tiktok
Stars: ✭ 20 (-20%)
PTTmineRParallel Searching and Crawling Data from PTT 🚀
Stars: ✭ 31 (+24%)
scraperNode.js based scraper using headless chrome
Stars: ✭ 45 (+80%)
wordpress-scraperSimple, easy-to-use scraper to scrape data from WordPress JSON API
Stars: ✭ 22 (-12%)
fanslySimply scrape / download all the media from an fansly account
Stars: ✭ 351 (+1304%)
robotstxtrobots.txt file parsing and checking for R
Stars: ✭ 65 (+160%)
INMET-API-temperatureCrawler dos dados metereológicos de estações convencionais do INMET (BDMEP)
Stars: ✭ 32 (+28%)
immo-feedA extensible app for scraping property listings
Stars: ✭ 35 (+40%)
linkedin-employee-scraperExtract all employees from LinkedIn. Especially useful for companies with thousands of employees.
Stars: ✭ 16 (-36%)
roseAnalyse all kinds of data for a TV series
Stars: ✭ 34 (+36%)
stweetAdvanced python library to scrap Twitter (tweets, users) from unofficial API
Stars: ✭ 287 (+1048%)
EsriRESTScraperA Python class that scrapes ESRI Rest Endpoints and exports data to a geodatabase
Stars: ✭ 43 (+72%)
scrapy-LBCAraignée LeBonCoin avec Scrapy et ElasticSearch
Stars: ✭ 14 (-44%)
OnlyFansScrape all the media from an OnlyFans account - Updated regularly
Stars: ✭ 573 (+2192%)
TikTokDownloader PyWebIO🚀「Douyin_TikTok_Download_API」是一个开箱即用的高性能异步抖音|TikTok数据爬取工具,支持API调用,在线批量解析及下载。
Stars: ✭ 919 (+3576%)
web-crawlerPython Web Crawler with Selenium and PhantomJS
Stars: ✭ 19 (-24%)
TelegramScraperUsing this tool you can easily add so many members from any group to your group. Less than 2 minutes. Super easy. Time saver. But this tool is only for educational purpose. You could be banned from Telegram. So be careful. Recommanded to use this tool only on Termux.
Stars: ✭ 234 (+836%)
ceiba-dlNTU CEIBA 資料下載工具
Stars: ✭ 80 (+220%)
nyt-first-saidTweets when words are published for the first time in the NYT
Stars: ✭ 222 (+788%)
instagram-get-imagesInstagram get images 🌄 (hashtags, account, locations) with puppeteer
Stars: ✭ 69 (+176%)
lopezCrawling and scraping the Web for fun and profit
Stars: ✭ 20 (-20%)
4scannerContinuously search imageboards threads for images/webms and download them
Stars: ✭ 103 (+312%)
Pahe.ph-ScraperPahe.ph [Pahe.in] Movies Website Scraper
Stars: ✭ 57 (+128%)
premeStockMonitors for restocks
Stars: ✭ 53 (+112%)
jd-autobuyPython爬虫,京东自动登录,在线抢购商品
Stars: ✭ 1,262 (+4948%)
extensionweb scraping extension
Stars: ✭ 28 (+12%)
RedditExtractorA minimalistic R wrapper for the Reddit API
Stars: ✭ 58 (+132%)
scrapmanRetrieve real (with Javascript executed) HTML code from an URL, ultra fast and supports multiple parallel loading of webs
Stars: ✭ 21 (-16%)
scraper图片爬取下载工具,极速爬取下载 站酷https://www.zcool.com.cn/, CNU 视觉 http://www.cnu.cc/ 设计师/用户 上传的 图片/照片/插画。
Stars: ✭ 64 (+156%)
yellowpages-scraperYellowpages.com Web Scraper written in Python and LXML to extract business details available based on a particular category and location.
Stars: ✭ 56 (+124%)
youtube-playlist❄️ Extract links, ids, and names from a youtube playlist
Stars: ✭ 73 (+192%)
MangDLThe most inefficient Manga downloader for PC
Stars: ✭ 40 (+60%)
savedditBulk Downloader for Reddit
Stars: ✭ 130 (+420%)
rymscraperPython API to extract data from rateyourmusic.com.
Stars: ✭ 63 (+152%)
PoliteBe nice on the web
Stars: ✭ 253 (+912%)
GChanScrape boards and threads from 4chan (8kun WIP). Downloads images, videos and HTML if desired.
Stars: ✭ 31 (+24%)
GetsyA simple browser/client-side web scraper.
Stars: ✭ 238 (+852%)
Annie👾 Fast and simple video download library and CLI tool written in Go
Stars: ✭ 16,369 (+65376%)
Ruiji.netcrawler framework, distributed crawler extractor
Stars: ✭ 220 (+780%)
antA web crawler for Go
Stars: ✭ 264 (+956%)
Media ScraperScrapes all photos and videos in a web page / Instagram / Twitter / Tumblr / Reddit / pixiv / TikTok
Stars: ✭ 206 (+724%)
civic-scraperTools for downloading agendas, minutes and other documents produced by local government
Stars: ✭ 21 (-16%)
zim-toolsVarious ZIM command line tools
Stars: ✭ 75 (+200%)
pyitauUnofficial client to access your Itaú bank data
Stars: ✭ 28 (+12%)
freeDictionaryAPIThere was no free Dictionary API on the web when I wanted one for my friend, so I created one.
Stars: ✭ 1,352 (+5308%)
proxycrawl-pythonProxyCrawl Python library for scraping and crawling
Stars: ✭ 51 (+104%)
CourseCakeBy serving course 📚 data that is more "edible" 🍰 for developers, we hope CourseCake offers a smooth approach to build useful tools for students.
Stars: ✭ 21 (-16%)
YT-DLP-SCRIPTS...Just a place for me to share my various YT-DLP & related bash scripts.
Stars: ✭ 70 (+180%)