AutocrawlerGoogle, Naver multiprocess image web crawler (Selenium)
Stars: ✭ 957 (+270.93%)
DownzemallDownZemAll! is a download manager for Windows, MacOS and Linux
Stars: ✭ 157 (-39.15%)
Tumblr BoilerplateA basic starting point for Tumblr theme development.
Stars: ✭ 10 (-96.12%)
Instagram Scraperscrapes medias, likes, followers, tags and all metadata. Inspired by instagram-php-scraper,bot
Stars: ✭ 2,209 (+756.2%)
GeccoEasy to use lightweight web crawler(易用的轻量化网络爬虫)
Stars: ✭ 2,310 (+795.35%)
GeziyorGeziyor, a fast web crawling & scraping framework for Go. Supports JS rendering.
Stars: ✭ 1,246 (+382.95%)
Sina Stock CrawlerSina stock options crawler with CSV output 新浪上证ETF期权数据爬虫
Stars: ✭ 12 (-95.35%)
DisecDistributed Image Search Engine Crawler
Stars: ✭ 11 (-95.74%)
Tumblr UtilsUtilities for dealing with Tumblr blogs, Tumblr backup
Stars: ✭ 616 (+138.76%)
NgmetaDynamic meta tags in your AngularJS single page application
Stars: ✭ 152 (-41.09%)
Pic Gather[ Closed ] 🎨 image collector, which supports custom acquisition source configuration and is compatible with MacOS and Windows operating systems.
Stars: ✭ 842 (+226.36%)
Ptt Alertor📢 Ptt 文章通知機器人!Notify Ptt Article in Realtime
Stars: ✭ 150 (-41.86%)
Appcrawler基于appium的app自动遍历工具
Stars: ✭ 925 (+258.53%)
FscrawlerElasticsearch File System Crawler (FS Crawler)
Stars: ✭ 906 (+251.16%)
CocrawlerCoCrawler is a versatile web crawler built using modern tools and concurrency.
Stars: ✭ 148 (-42.64%)
Zhihu Crawlerzhihu-crawler是一个基于Java的高性能、支持免费http代理池、支持横向扩展、分布式爬虫项目
Stars: ✭ 890 (+244.96%)
dijnet-botAz összes számlád még egy helyen :)
Stars: ✭ 17 (-93.41%)
PythonPython脚本。模拟登录知乎, 爬虫,操作excel,微信公众号,远程开机
Stars: ✭ 7,355 (+2750.78%)
Pachong一些爬虫的代码
Stars: ✭ 147 (-43.02%)
Lulu[Unmaintained] A simple and clean video/music/image downloader 👾
Stars: ✭ 789 (+205.81%)
Th Music Video GeneratorTouhou Project random music video generator/player, crawling image and video from websites to generate MV.
Stars: ✭ 146 (-43.41%)
CrawlerA high performance web crawler in Elixir.
Stars: ✭ 781 (+202.71%)
img-cliAn interactive Command-Line Interface Build in NodeJS for downloading a single or multiple images to disk from URL
Stars: ✭ 15 (-94.19%)
Creeper🐾 Creeper - The Next Generation Crawler Framework (Go)
Stars: ✭ 762 (+195.35%)
CrawlerGo process used to crawl websites
Stars: ✭ 147 (-43.02%)
Magnet Dht✌️ Python3 BitTorrent DHT crawler
Stars: ✭ 692 (+168.22%)
Gallery DlCommand-line program to download image galleries and collections from several image hosting sites
Stars: ✭ 4,199 (+1527.52%)
Grab SiteThe archivist's web crawler: WARC output, dashboard for all crawls, dynamic ignore patterns
Stars: ✭ 680 (+163.57%)
ScrapyrtHTTP API for Scrapy spiders
Stars: ✭ 637 (+146.9%)
tg crawlerJust a crawler based on tg-cli for Telegram. Deprecated by now, please use telegram-export.
Stars: ✭ 71 (-72.48%)
IcrawlerA multi-thread crawler framework with many builtin image crawlers provided.
Stars: ✭ 629 (+143.8%)
Youtube ProjectsThis repository contains all the code I use in my YouTube tutorials.
Stars: ✭ 144 (-44.19%)
PoliteBe nice on the web
Stars: ✭ 253 (-1.94%)
Google Play ScraperGoogle play scraper for Python inspired by <facundoolano/google-play-scraper>
Stars: ✭ 143 (-44.57%)
NetdiscoveryNetDiscovery 是一款基于 Vert.x、RxJava 2 等框架实现的通用爬虫框架/中间件。
Stars: ✭ 573 (+122.09%)
papercutPapercut is a scraping/crawling library for Node.js built on top of JSDOM. It provides basic selector features together with features like Page Caching and Geosearch.
Stars: ✭ 15 (-94.19%)
OddishTo crawl all csgo skins from website.
Stars: ✭ 139 (-46.12%)
SpidyThe simple, easy to use command line web crawler.
Stars: ✭ 257 (-0.39%)
galerA fast tool to fetch URLs from HTML attributes by crawl-in.
Stars: ✭ 138 (-46.51%)
html-queryA fluent and functional approach to querying HTML
Stars: ✭ 48 (-81.4%)
spiderable-middleware🤖 Prerendering for JavaScript powered websites. Great solution for PWAs (Progressive Web Apps), SPAs (Single Page Applications), and other websites based on top of front-end JavaScript frameworks
Stars: ✭ 29 (-88.76%)
Goribot[Crawler/Scraper for Golang]🕷A lightweight distributed friendly Golang crawler framework.一个轻量的分布式友好的 Golang 爬虫框架。
Stars: ✭ 190 (-26.36%)
Acm StatisticsAn online tool (crawler) to analyze users performance in online judges (coding competition websites). Supported OJ: POJ, HDU, ZOJ, HYSBZ, CodeForces, UVA, ICPC Live Archive, FZU, SPOJ, Timus (URAL), LeetCode_CN, CSU, LibreOJ, 洛谷, 牛客OJ, Lutece (UESTC), AtCoder, AIZU, CodeChef, El Judge, BNUOJ, Codewars, UOJ, NBUT, 51Nod, DMOJ, VJudge
Stars: ✭ 83 (-67.83%)