SkraperKotlin/Java library and cli tool for scraping posts and media from various sources with neither authorization nor full page rendering (Facebook, Instagram, Twitter, Youtube, Tiktok, Telegram, Twitch, Reddit, 9GAG, Pinterest, Flickr, Tumblr, IFunny, VK, Pikabu)
Stars: ✭ 72 (+53.19%)
Youtube ProjectsThis repository contains all the code I use in my YouTube tutorials.
Stars: ✭ 144 (+206.38%)
Instagram Scraperscrapes medias, likes, followers, tags and all metadata. Inspired by instagram-php-scraper,bot
Stars: ✭ 2,209 (+4600%)
Media ScraperScrapes all photos and videos in a web page / Instagram / Twitter / Tumblr / Reddit / pixiv / TikTok
Stars: ✭ 206 (+338.3%)
OnegramThis repository is no longer maintained.
Stars: ✭ 137 (+191.49%)
Instagram CrawlerCrawl instagram photos, posts and videos for download.
Stars: ✭ 178 (+278.72%)
Annie👾 Fast and simple video download library and CLI tool written in Go
Stars: ✭ 16,369 (+34727.66%)
dijnet-botAz összes számlád még egy helyen :)
Stars: ✭ 17 (-63.83%)
Weibo terminator workflowUpdate Version of weibo_terminator, This is Workflow Version aim at Get Job Done!
Stars: ✭ 259 (+451.06%)
AvbookAV 电影管理系统, avmoo , javbus , javlibrary 爬虫,线上 AV 影片图书馆,AV 磁力链接数据库,Japanese Adult Video Library,Adult Video Magnet Links - Japanese Adult Video Database
Stars: ✭ 8,133 (+17204.26%)
botCompletely free and open-source human-like Instagram bot. Powered by UIAutomator2 and compatible with basically any Android device 5.0+ that can run Instagram - real or emulated.
Stars: ✭ 321 (+582.98%)
alternative-front-endsOverview of alternative open source front-ends for popular internet platforms (e.g. YouTube, Twitter, etc.)
Stars: ✭ 1,664 (+3440.43%)
bots-zooNo description or website provided.
Stars: ✭ 59 (+25.53%)
Socialmanagertools Gui🤖 👻 Desktop application for Instagram Bot, Twitter Bot and Facebook Bot
Stars: ✭ 293 (+523.4%)
EmberaA Oembed consumer library, that gives you information about urls. It helps you replace urls to youtube or vimeo for example, with their html embed code. It has advanced features like offline support, responsive embeds and caching support.
Stars: ✭ 268 (+470.21%)
Privacy RedirectA simple web extension that redirects Twitter, YouTube, Instagram & Google Maps requests to privacy friendly alternatives.
Stars: ✭ 342 (+627.66%)
J.a.r.v.i.spython powered Intelligent System
Stars: ✭ 325 (+591.49%)
Freshonions TorscraperFresh Onions is an open source TOR spider / hidden service onion crawler hosted at zlal32teyptf4tvi.onion
Stars: ✭ 348 (+640.43%)
Osi.igInformation Gathering Instagram.
Stars: ✭ 377 (+702.13%)
ScrapedinLinkedIn Scraper (currently working 2020)
Stars: ✭ 453 (+863.83%)
FerretDeclarative web scraping
Stars: ✭ 4,837 (+10191.49%)
FbcrawlA Facebook crawler
Stars: ✭ 536 (+1040.43%)
arachnodHigh performance crawler for Nodejs
Stars: ✭ 17 (-63.83%)
papercutPapercut is a scraping/crawling library for Node.js built on top of JSDOM. It provides basic selector features together with features like Page Caching and Geosearch.
Stars: ✭ 15 (-68.09%)
SocialInfo4Jfetch data from Facebook, Instagram and LinkedIn
Stars: ✭ 44 (-6.38%)
SharpGrabberDownload from YouTube, Vimeo, PornHub, HLS (M3U8 files) with .NET and JavaScript, Library and desktop app for downloading high quality media
Stars: ✭ 138 (+193.62%)
Instagram-Scraper-2021Scrape Instagram content and stories anonymously, using a new technique based on the har file (No Token + No public API).
Stars: ✭ 57 (+21.28%)
lightnovel epub🍭 epub generator for (light)novels (轻) 小说 epub 生成器,支持站点:轻之国度、轻小说文库
Stars: ✭ 89 (+89.36%)
Instagram-Comments-ScraperInstagram comment scraper using python and selenium. Save the comments into excel.
Stars: ✭ 73 (+55.32%)
Sasila一个灵活、友好的爬虫框架
Stars: ✭ 286 (+508.51%)
Rsshub🍰 Everything is RSSible
Stars: ✭ 18,111 (+38434.04%)
Hquery.phpAn extremely fast web scraper that parses megabytes of invalid HTML in a blink of an eye. PHP5.3+, no dependencies.
Stars: ✭ 295 (+527.66%)
RcrawlerAn R web crawler and scraper
Stars: ✭ 274 (+482.98%)
Xcrawler快速、简洁且强大的PHP爬虫框架
Stars: ✭ 344 (+631.91%)
AutoscraperA Smart, Automatic, Fast and Lightweight Web Scraper for Python
Stars: ✭ 4,077 (+8574.47%)
InstagramcrawlerA non API python program to crawl public photos, posts or followers
Stars: ✭ 349 (+642.55%)
BookcorpusCrawl BookCorpus
Stars: ✭ 443 (+842.55%)
CrawlyCrawly, a high-level web crawling & scraping framework for Elixir.
Stars: ✭ 440 (+836.17%)
Feeds Importiert Daten aus API-Quellen wie Facebook, Instagram, Twitter, YouTube, Vimeo oder RSS (ehemals YFeed)
Stars: ✭ 34 (-27.66%)
Instagram ScraperScrapes an instagram user's photos and videos
Stars: ✭ 5,664 (+11951.06%)
Awesome CrawlerA collection of awesome web crawler,spider in different languages
Stars: ✭ 4,793 (+10097.87%)
GosintOSINT Swiss Army Knife
Stars: ✭ 401 (+753.19%)
Rssbox📰 I consume the world via RSS feeds, and this is my attempt to keep it that way.
Stars: ✭ 492 (+946.81%)
Course Crawler🎓 中国大学MOOC、学堂在线、网易云课堂、好大学在线、爱课程 MOOC 课程下载。
Stars: ✭ 611 (+1200%)
Instagram CrawlerGet Instagram posts/profile/hashtag data without using Instagram API
Stars: ✭ 643 (+1268.09%)
ScrapyrtHTTP API for Scrapy spiders
Stars: ✭ 637 (+1255.32%)
SpidrA versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.
Stars: ✭ 656 (+1295.74%)
Lulu[Unmaintained] A simple and clean video/music/image downloader 👾
Stars: ✭ 789 (+1578.72%)
Price Monitor京东商品价格监控:监控用户设定商品价格,降价邮件/微信提醒。技术:Python爬虫/IP代理池/JS接口爬取/Selenium页面爬取
Stars: ✭ 634 (+1248.94%)
CrawlerA high performance web crawler in Elixir.
Stars: ✭ 781 (+1561.7%)