Lulu[Unmaintained] A simple and clean video/music/image downloader 👾
Stars: ✭ 789 (+5535.71%)
wget-luaWget-AT is a modern Wget with Lua hooks, Zstandard (+dictionary) WARC compression and URL-agnostic deduplication.
Stars: ✭ 52 (+271.43%)
SerpscrapSEO python scraper to extract data from major searchengine result pages. Extract data like url, title, snippet, richsnippet and the type from searchresults for given keywords. Detect Ads or make automated screenshots. You can also fetch text content of urls provided in searchresults or by your own. It's usefull for SEO and business related research tasks.
Stars: ✭ 153 (+992.86%)
Website-downloader💡 Download the complete source code of any website (including all assets). [ Javascripts, Stylesheets, Images ] using Node.js
Stars: ✭ 615 (+4292.86%)
Email ExtractorThe main functionality is to extract all the emails from one or several URLs - La funcionalidad principal es extraer todos los correos electrónicos de una o varias Url
Stars: ✭ 81 (+478.57%)
UdemycoursegrabberYour will to enroll in Udemy course is here, but the money isn't? Search no more! This python program searches for your desired course in more than [insert big number here] websites, compares the last updated date, and gives you the download link of the latest one back, but you also have the choice to see the other ones as well!
Stars: ✭ 137 (+878.57%)
Scrape Linkedin Selenium`scrape_linkedin` is a python package that allows you to scrape personal LinkedIn profiles & company pages - turning the data into structured json.
Stars: ✭ 239 (+1607.14%)
google-scraperThis class can retrieve search results from Google.
Stars: ✭ 33 (+135.71%)
4scannerContinuously search imageboards threads for images/webms and download them
Stars: ✭ 103 (+635.71%)
TikTokDownload public videos on TikTok using Python with Selenium
Stars: ✭ 37 (+164.29%)
TorScrapperA Scraper made 100% in Python using BeautifulSoup and Tor. It can be used to scrape both normal and onion links. Happy Scraping :)
Stars: ✭ 24 (+71.43%)
papercutPapercut is a scraping/crawling library for Node.js built on top of JSDOM. It provides basic selector features together with features like Page Caching and Geosearch.
Stars: ✭ 15 (+7.14%)
Instascrape🚀 A fast and lightweight utility and Python library for downloading posts, stories, and highlights from Instagram.
Stars: ✭ 76 (+442.86%)
SeleniumcrawlerAn example using Selenium webdrivers for python and Scrapy framework to create a web scraper to crawl an ASP site
Stars: ✭ 117 (+735.71%)
GeziyorGeziyor, a fast web crawling & scraping framework for Go. Supports JS rendering.
Stars: ✭ 1,246 (+8800%)
Goose ParserUniversal scrapping tool, which allows you to extract data using multiple environments
Stars: ✭ 211 (+1407.14%)
Scrapysharpreborn of https://bitbucket.org/rflechner/scrapysharp
Stars: ✭ 226 (+1514.29%)
nipper🌶 💽 Nipper - Youtube playlist (& video) ripper
Stars: ✭ 23 (+64.29%)
Linkedin Profile Scraper🕵️♂️ LinkedIn profile scraper returning structured profile data in JSON. Works in 2020.
Stars: ✭ 171 (+1121.43%)
diffbot-php-client[Deprecated - Maintenance mode - use APIs directly please!] The official Diffbot client library
Stars: ✭ 53 (+278.57%)
savedditBulk Downloader for Reddit
Stars: ✭ 130 (+828.57%)
OnlyFansScrape all the media from an OnlyFans account - Updated regularly
Stars: ✭ 573 (+3992.86%)
lux👾 Fast and simple video download library and CLI tool written in Go
Stars: ✭ 19,266 (+137514.29%)
document-dlCommand line program to download documents from web portals.
Stars: ✭ 14 (+0%)
Captcha-ToolsAll-in-one Python (And now Go!) module to help solve captchas with Capmonster, 2captcha and Anticaptcha API's!
Stars: ✭ 23 (+64.29%)
PypatentSearch for and retrieve US Patent and Trademark Office Patent Data
Stars: ✭ 31 (+121.43%)
Spam Bot 3000Social media research and promotion, semi-autonomous CLI bot
Stars: ✭ 79 (+464.29%)
Yts ScraperDownload .torrent files from YTS YIFY
Stars: ✭ 19 (+35.71%)
Cumcomic updater, mangafied
Stars: ✭ 117 (+735.71%)
SillyniumAutomate the creation of Python Selenium Scripts by drawing coloured boxes on webpage elements
Stars: ✭ 100 (+614.29%)
PhpscraperPHP Scraper - an highly opinionated web-interface for PHP
Stars: ✭ 148 (+957.14%)
CollyElegant Scraper and Crawler Framework for Golang
Stars: ✭ 15,535 (+110864.29%)
Jsonframe Cheeriosimple multi-level scraper json input/output for Cheerio
Stars: ✭ 196 (+1300%)
Annie👾 Fast and simple video download library and CLI tool written in Go
Stars: ✭ 16,369 (+116821.43%)
Anime DlAnime-dl is a command-line program to download anime from CrunchyRoll and Funimation.
Stars: ✭ 190 (+1257.14%)
Pahe.ph-ScraperPahe.ph [Pahe.in] Movies Website Scraper
Stars: ✭ 57 (+307.14%)
Imagescraper✂️ High performance, multi-threaded image scraper
Stars: ✭ 630 (+4400%)
fanslySimply scrape / download all the media from an fansly account
Stars: ✭ 351 (+2407.14%)
scrapersscrapers for building your own image databases
Stars: ✭ 46 (+228.57%)
vsco-scraperEasily allows for scraping a VSCO
Stars: ✭ 106 (+657.14%)
turtleInstagram Photo Downloader
Stars: ✭ 15 (+7.14%)
YouTube-MA💾 YouTube video metadata archiver written in Golang
Stars: ✭ 17 (+21.43%)
scrapmanRetrieve real (with Javascript executed) HTML code from an URL, ultra fast and supports multiple parallel loading of webs
Stars: ✭ 21 (+50%)
ha-multiscrapeHome Assistant custom component for scraping (html, xml or json) multiple values (from a single HTTP request) with a separate sensor/attribute for each value. Support for (login) form-submit functionality.
Stars: ✭ 103 (+635.71%)
canvas-recordA one trick pony package to record and download a video from a canvas animation.
Stars: ✭ 64 (+357.14%)
anime-scraper[partially working] Scrape and add anime episode stream URLs to uGet (Linux) or IDM (Windows) ~ Python3
Stars: ✭ 21 (+50%)
copycatA PHP Scraping Class
Stars: ✭ 70 (+400%)
proxycrawl-pythonProxyCrawl Python library for scraping and crawling
Stars: ✭ 51 (+264.29%)
patreon-scraperWIP Patreon attachment download written in TypeScript
Stars: ✭ 25 (+78.57%)
RedditdownloaderScrapes Reddit to download media of your choice.
Stars: ✭ 521 (+3621.43%)
gochanges**[ARCHIVED]** website changes tracker 🔍
Stars: ✭ 12 (-14.29%)
Instagram-to-discordMonitor instagram user account and automatically post new images to discord channel via a webhook. Working 2022!
Stars: ✭ 113 (+707.14%)
Scraper-Projects🕸 List of mini projects that involve web scraping 🕸
Stars: ✭ 25 (+78.57%)
scrapy facebookerCollection of scrapy spiders which can scrape posts, images, and so on from public Facebook Pages.
Stars: ✭ 22 (+57.14%)