JlitespiderA lite distributed Java spider framework :-)
Stars: ✭ 151 (+1272.73%)
GoscraperGolang pkg to quickly return a preview of a webpage (title/description/images)
Stars: ✭ 72 (+554.55%)
Scrapy RedisRedis-based components for Scrapy.
Stars: ✭ 4,998 (+45336.36%)
DotnetspiderDotnetSpider, a .NET standard web crawling library. It is lightweight, efficient and fast high-level web crawling & scraping framework
Stars: ✭ 3,233 (+29290.91%)
Laosjgolang light-weight image crawler
Stars: ✭ 199 (+1709.09%)
Spoon🥄 A package for building specific Proxy Pool for different Sites.
Stars: ✭ 173 (+1472.73%)
Lizard💐 Full Amazon Automatic Download
Stars: ✭ 41 (+272.73%)
Haipproxy💖 High available distributed ip proxy pool, powerd by Scrapy and Redis
Stars: ✭ 4,993 (+45290.91%)
Xxl CrawlerA distributed web crawler framework.(分布式爬虫框架XXL-CRAWLER)
Stars: ✭ 561 (+5000%)
PapillonA distributed blog publish system based on IPFS
Stars: ✭ 19 (+72.73%)
CometaSuper fast, on-demand and on-the-fly, image processing.
Stars: ✭ 8 (-27.27%)
V PhotoswipeVue plugin for image preview base on PhotoSwipe
Stars: ✭ 25 (+127.27%)
SdwebimageflpluginA SDWebImage plugin to support GIF using FLAnimatedImage and category
Stars: ✭ 16 (+45.45%)
Psi ReportCrawls a website, gets PageSpeed Insights data for each page, and exports an HTML report.
Stars: ✭ 6 (-45.45%)
Appcrawler基于appium的app自动遍历工具
Stars: ✭ 925 (+8309.09%)
TorbotDark Web OSINT Tool
Stars: ✭ 821 (+7363.64%)
ImageJoomla Framework Image Package
Stars: ✭ 9 (-18.18%)
TumblthreeA Tumblr Blog Backup Application
Stars: ✭ 923 (+8290.91%)
Instagram Profilecrawl📝 quickly crawl the information (e.g. followers, tags etc...) of an instagram profile.
Stars: ✭ 816 (+7318.18%)
ScrimageJava, Scala and Kotlin image processing library
Stars: ✭ 792 (+7100%)
NyxA simple imageboard with no javascript or dependencies written in Go
Stars: ✭ 19 (+72.73%)
Subnode.orgSubNode: Social Media App
Stars: ✭ 25 (+127.27%)
ExhibitExhibit is a managed screensaver App for tvOS.
Stars: ✭ 19 (+72.73%)
FinalreconThe Last Web Recon Tool You'll Need
Stars: ✭ 888 (+7972.73%)
ScrapitScraping scripts for various websites.
Stars: ✭ 25 (+127.27%)
Zhihu Crawlerzhihu-crawler是一个基于Java的高性能、支持免费http代理池、支持横向扩展、分布式爬虫项目
Stars: ✭ 890 (+7990.91%)
Cachep2p"More users = More capacity"
Stars: ✭ 855 (+7672.73%)
HashtopolisA Hashcat wrapper for distributed hashcracking
Stars: ✭ 835 (+7490.91%)
RemitRabbitMQ-backed microservices supporting RPC, pubsub, automatic service discovery and scaling with no code changes.
Stars: ✭ 24 (+118.18%)
CdpimagecropCDPImageCrop can zoom,move and crop a image and automatically save into the album,details see demo.
Stars: ✭ 6 (-45.45%)
PythonPython脚本。模拟登录知乎, 爬虫,操作excel,微信公众号,远程开机
Stars: ✭ 7,355 (+66763.64%)
React Optimized ImageEasy to use React components for optimized-images-loader / next-optimized-images.
Stars: ✭ 24 (+118.18%)
Holochain ProtoHolographic storage for distributed applications -- a validating monotonic DHT "backed" by authoritative hashchains for data provenance (a Ceptr sub-project)
Stars: ✭ 795 (+7127.27%)
Py Style Transfer🎨 Artistic neural style transfer with tweaks (pytorch).
Stars: ✭ 23 (+109.09%)
Pic Gather[ Closed ] 🎨 image collector, which supports custom acquisition source configuration and is compatible with MacOS and Windows operating systems.
Stars: ✭ 842 (+7554.55%)
Distribyted📂 ➡️ 📺 🎶 🎮 Torrent client with on-demand file downloading as a filesystem.
Stars: ✭ 791 (+7090.91%)
Scrapy ClusterThis Scrapy project uses Redis and Kafka to create a distributed on demand scraping cluster.
Stars: ✭ 921 (+8272.73%)
Aws Lambda ImageAutomatic image resize/reduce on AWS Lambda
Stars: ✭ 790 (+7081.82%)
Lulu[Unmaintained] A simple and clean video/music/image downloader 👾
Stars: ✭ 789 (+7072.73%)
Mzitu👧 美女写真套图爬虫(二)
Stars: ✭ 920 (+8263.64%)
TitanoboaTitanoboa makes complex workflows easy. It is a low-code workflow orchestration platform for JVM - distributed, highly scalable and fault tolerant.
Stars: ✭ 787 (+7054.55%)
GospiderGospider - Fast web spider written in Go
Stars: ✭ 785 (+7036.36%)
Sqlivmassive SQL injection vulnerability scanner
Stars: ✭ 840 (+7536.36%)
Eager Image LoaderThe eager-loading for image files on the web page that loads the files according to your plan. This differs from the lazy-loading, for example, this can be used to avoid that the user waits for the loading.
Stars: ✭ 22 (+100%)
Image OptimizerImage optimization / compression library. This library is able to optimize png, jpg and gif files in very easy and handy way. It uses optipng, pngquant, pngcrush, pngout, gifsicle, jpegoptim and jpegtran tools.
Stars: ✭ 785 (+7036.36%)
AgolaAgola: CI/CD Redefined
Stars: ✭ 783 (+7018.18%)
React ImageReact.js <img> tag rendering with multiple fallback & loader support
Stars: ✭ 917 (+8236.36%)
CrawlerA high performance web crawler in Elixir.
Stars: ✭ 781 (+7000%)
ImageManipulate images with an expressive API
Stars: ✭ 781 (+7000%)