ReginaFetch new releases from http://www.juno.co.uk/.
Stars: ✭ 6 (-71.43%)
Website-downloader💡 Download the complete source code of any website (including all assets). [ Javascripts, Stylesheets, Images ] using Node.js
Stars: ✭ 615 (+2828.57%)
ImdbpyIMDbPY is a Python package useful to retrieve and manage the data of the IMDb movie database about movies, people, characters and companies
Stars: ✭ 792 (+3671.43%)
youtube-unofficialAccess parts of your account unavailable through normal YouTube API access.
Stars: ✭ 33 (+57.14%)
CrawlerA high performance web crawler in Elixir.
Stars: ✭ 781 (+3619.05%)
laravel-meta💥 Render meta tags within your Laravel application
Stars: ✭ 36 (+71.43%)
OnlyfansScrape all the media from an OnlyFans account - Updated regularly
Stars: ✭ 731 (+3380.95%)
civic-scraperTools for downloading agendas, minutes and other documents produced by local government
Stars: ✭ 21 (+0%)
SurgeonDeclarative DOM extraction expression evaluator. 👨⚕️
Stars: ✭ 653 (+3009.52%)
nyt-first-saidTweets when words are published for the first time in the NYT
Stars: ✭ 222 (+957.14%)
ScrapyrtHTTP API for Scrapy spiders
Stars: ✭ 637 (+2933.33%)
Imagescraper✂️ High performance, multi-threaded image scraper
Stars: ✭ 630 (+2900%)
readability-cliA CLI for Mozilla Readability. Get clean, uncluttered, ready-to-read HTML from any webpage!
Stars: ✭ 41 (+95.24%)
unfurlExtract rich metadata from URLs
Stars: ✭ 41 (+95.24%)
FbcrawlA Facebook crawler
Stars: ✭ 536 (+2452.38%)
file-extensionsJSON collection of scraped file extensions, along with their description and type, from FileInfo.com
Stars: ✭ 15 (-28.57%)
JikanUnofficial MyAnimeList PHP+REST API which provides functions other than the official API
Stars: ✭ 531 (+2428.57%)
GeziyorGeziyor, a fast web crawling & scraping framework for Go. Supports JS rendering.
Stars: ✭ 1,246 (+5833.33%)
RedditdownloaderScrapes Reddit to download media of your choice.
Stars: ✭ 521 (+2380.95%)
FinvizUnofficial API for finviz.com
Stars: ✭ 493 (+2247.62%)
robotstxtrobots.txt file parsing and checking for R
Stars: ✭ 65 (+209.52%)
scrapeerEssential PHP library that scrapes HTTP(S) and UDP trackers for torrent information.
Stars: ✭ 81 (+285.71%)
Hoomanhttp interceptor to hoomanize cloudflare requests
Stars: ✭ 82 (+290.48%)
proxy-scraper⭐️ A proxy scraper made using Protractor | Proxy list Updates every three hour 🔥
Stars: ✭ 201 (+857.14%)
DataflowkitExtract structured data from web sites. Web sites scraping.
Stars: ✭ 456 (+2071.43%)
newsembleAPI for fetching data from news websites.
Stars: ✭ 42 (+100%)
BookcorpusCrawl BookCorpus
Stars: ✭ 443 (+2009.52%)
RedditExtractorA minimalistic R wrapper for the Reddit API
Stars: ✭ 58 (+176.19%)
SnscrapeA social networking service scraper in Python
Stars: ✭ 433 (+1961.9%)
OnlyFansScrape all the media from an OnlyFans account - Updated regularly
Stars: ✭ 573 (+2628.57%)
GosintOSINT Swiss Army Knife
Stars: ✭ 401 (+1809.52%)
pupflareA webpage proxy that request through Chromium (puppeteer) - can be used to bypass Cloudflare anti bot / anti ddos on any application (like curl)
Stars: ✭ 183 (+771.43%)
Finance Go📊 Financial markets data library implemented in go.
Stars: ✭ 392 (+1766.67%)
Osi.igInformation Gathering Instagram.
Stars: ✭ 377 (+1695.24%)
yellowpages-scraperYellowpages.com Web Scraper written in Python and LXML to extract business details available based on a particular category and location.
Stars: ✭ 56 (+166.67%)
instagram-get-imagesInstagram get images 🌄 (hashtags, account, locations) with puppeteer
Stars: ✭ 69 (+228.57%)
KatanaA Python Tool For google Hacking
Stars: ✭ 355 (+1590.48%)
MangDLThe most inefficient Manga downloader for PC
Stars: ✭ 40 (+90.48%)
Xcrawler快速、简洁且强大的PHP爬虫框架
Stars: ✭ 344 (+1538.1%)
covid-19Current and historical coronavirus covid-19 confirmed, recovered, deaths and active case counts segmented by country and region. Includes csv, json and sqlite data along with an interactive website explorer.
Stars: ✭ 15 (-28.57%)
JavgoJavGo是一个集合影片管理,影片刮削,视频处理,资源搜索等综合一体的全功能影音软件,支持爬取javbus,jav321,javdb,javlibrary进行刮削,支持db,bus的磁力搜索,支持获取library的影片评论。
Stars: ✭ 338 (+1509.52%)
ryuanimeA free anime streaming , using the jkanime content by scraping the jkanime website.
Stars: ✭ 20 (-4.76%)
LinkedinLinkedin Scraper using Selenium Web Driver, Chromium headless, Docker and Scrapy
Stars: ✭ 309 (+1371.43%)
YouTube-MA💾 YouTube video metadata archiver written in Golang
Stars: ✭ 17 (-19.05%)
Hquery.phpAn extremely fast web scraper that parses megabytes of invalid HTML in a blink of an eye. PHP5.3+, no dependencies.
Stars: ✭ 295 (+1304.76%)
TwitterScraperScrape a User's Twitter data! Bypass the 3,200 tweet API limit for a User!
Stars: ✭ 80 (+280.95%)
site-audit-seoWeb service and CLI tool for SEO site audit: crawl site, lighthouse all pages, view public reports in browser. Also output to console, json, csv, xlsx, Google Drive.
Stars: ✭ 91 (+333.33%)
Email ExtractorThe main functionality is to extract all the emails from one or several URLs - La funcionalidad principal es extraer todos los correos electrónicos de una o varias Url
Stars: ✭ 81 (+285.71%)
Heroku ebooksA script to generate Markov chains and to post to an _ebooks account on Twitter using Heroku
Stars: ✭ 251 (+1095.24%)
scrapy facebookerCollection of scrapy spiders which can scrape posts, images, and so on from public Facebook Pages.
Stars: ✭ 22 (+4.76%)
evineInteractive CLI Web Crawler
Stars: ✭ 140 (+566.67%)
Scraper-Projects🕸 List of mini projects that involve web scraping 🕸
Stars: ✭ 25 (+19.05%)
scrapisma work-in-progress guide to web scraping as an artistic and critical practice
Stars: ✭ 43 (+104.76%)
TrollHunterTwitter Troll & Fake News Hunter - Crawls news websites and twitter to identify fake news
Stars: ✭ 38 (+80.95%)
pyitauUnofficial client to access your Itaú bank data
Stars: ✭ 28 (+33.33%)
WombatLightweight Ruby web crawler/scraper with an elegant DSL which extracts structured data from pages.
Stars: ✭ 1,220 (+5709.52%)