Spider Flow新一代爬虫平台,以图形化方式定义爬虫流程,不写代码即可完成爬虫。
Stars: ✭ 365 (+461.54%)
SupercrawlerA web crawler. Supercrawler automatically crawls websites. Define custom handlers to parse content. Obeys robots.txt, rate limits and concurrency limits.
Stars: ✭ 306 (+370.77%)
Storm CrawlerA scalable, mature and versatile web crawler based on Apache Storm
Stars: ✭ 703 (+981.54%)
Wasm ImagemagickWebassembly compilation of https://github.com/ImageMagick/ImageMagick & samples
Stars: ✭ 442 (+580%)
UnChainA tool to find redirection chains in multiple URLs
Stars: ✭ 77 (+18.46%)
Gifcurry😎 The open-source, Haskell-built video editor for GIF makers.
Stars: ✭ 830 (+1176.92%)
ImageflowHigh-performance image manipulation for web servers. Includes imageflow_server, imageflow_tool, and libimageflow
Stars: ✭ 3,643 (+5504.62%)
MamanRust Web Crawler saving pages on Redis
Stars: ✭ 39 (-40%)
Gopa[WIP] GOPA, a spider written in Golang, for Elasticsearch. DEMO: http://index.elasticsearch.cn
Stars: ✭ 277 (+326.15%)
Slopslop (Select Operation) is an application that queries for a selection from the user and prints the region to stdout.
Stars: ✭ 639 (+883.08%)
Ngx small lightDynamic Image Transformation Module For nginx.
Stars: ✭ 447 (+587.69%)
imgoutOn the fly thumbnail generator microservice using Elixir/OTP. (with Heroku Deploy Button)
Stars: ✭ 58 (-10.77%)
SiteshotWebsite screenshot capturer written in Go.
Stars: ✭ 18 (-72.31%)
Weibo AnalystSocial media (Weibo) comments analyzing toolbox in Chinese 微博评论分析工具, 实现功能: 1.微博评论数据爬取; 2.分词与关键词提取; 3.词云与词频统计; 4.情感分析; 5.主题聚类
Stars: ✭ 430 (+561.54%)
CrawlabDistributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台,支持任何语言和框架
Stars: ✭ 8,392 (+12810.77%)
SparklerSpark-Crawler: Apache Nutch-like crawler that runs on Apache Spark.
Stars: ✭ 362 (+456.92%)
ImgbotAn Azure Function solution to crawl through all of your image files in GitHub and losslessly compress them. This will make the file size go down, but leave the dimensions and quality untouched. Once it's done, ImgBot will open a pull request for you to review and merge. [email protected]
Stars: ✭ 732 (+1026.15%)
AcheACHE is a web crawler for domain-specific search.
Stars: ✭ 320 (+392.31%)
Jekyll Assets🎨 Asset pipelines for Jekyll.
Stars: ✭ 1,083 (+1566.15%)
Emax6464-bit Emacs for Windows with ImageMagick 7
Stars: ✭ 301 (+363.08%)
Gifify😻 Convert any video file to an optimized animated GIF.
Stars: ✭ 5,792 (+8810.77%)
SpidyThe simple, easy to use command line web crawler.
Stars: ✭ 257 (+295.38%)
DoctopicsVarious examples of topic modeling and other text analysis
Stars: ✭ 32 (-50.77%)
crops🌄 Image thumbnail generation server
Stars: ✭ 37 (-43.08%)
LibvipsA fast image processing library with low memory needs.
Stars: ✭ 6,094 (+9275.38%)
Awesome CrawlerA collection of awesome web crawler,spider in different languages
Stars: ✭ 4,793 (+7273.85%)
wordfish-pythonextract relationships from standardized terms from corpus of interest with deep learning 🐟
Stars: ✭ 19 (-70.77%)
Sv ImagesImage manipulation library with an HTTP based API.
Stars: ✭ 7 (-89.23%)
MogrifyImage processing in Elixir (ImageMagick command line wrapper)
Stars: ✭ 442 (+580%)
Social Media Depression Detector😔 😞 😣 😖 😩 Detect depression on social media using the ssToT method introduced in our ASONAM 2017 paper titled "Semi-Supervised Approach to Monitoring Clinical Depressive Symptoms in Social Media"
Stars: ✭ 45 (-30.77%)
GovipsA lightning fast image processing and resizing library for Go
Stars: ✭ 442 (+580%)
MockupPerspective app screens and isometric mock-up tool. Automated high quality, high resolution, marketing art designer for mockups. Written in minimalist Bash using ImageMagick and Love! [Application, Art]
Stars: ✭ 18 (-72.31%)
VipsGo Bindings for Vips (a super fast image processor)
Stars: ✭ 380 (+484.62%)
ImagerImage processing proxy
Stars: ✭ 56 (-13.85%)
MagickMagic, madness, heaven, sin
Stars: ✭ 362 (+456.92%)
FlyimgDockerized PHP7 application runs as a Microservice to resize and crop images on the fly. Get optimised images with MozJPEG, WebP or PNG using ImageMagick. Includes face detection, cropping, face blurring, image rotation and many other options. Abstract storage based on FlySystem in order to store images on any provider (local, AWS S3...).
Stars: ✭ 762 (+1072.31%)
MoebooruMoebooru, a fork of danbooru1 that has been heavily modified
Stars: ✭ 347 (+433.85%)
Mod dimsApache HTTP dynamic image resizing module
Stars: ✭ 40 (-38.46%)
SkeptickBetter ImageMagick for Ruby
Stars: ✭ 326 (+401.54%)
Jekyll Gallery GeneratorA Jekyll plugin that generates photo galleries from directories full of images.
Stars: ✭ 315 (+384.62%)
NlpSelected Machine Learning algorithms for natural language processing and semantic analysis in Golang
Stars: ✭ 304 (+367.69%)
Php QrcodeA QR Code generator for PHP7.4+
Stars: ✭ 685 (+953.85%)
Patternrecognition matlabFeature reduction projections and classifier models are learned by training dataset and applied to classify testing dataset. A few approaches of feature reduction have been compared in this paper: principle component analysis (PCA), linear discriminant analysis (LDA) and their kernel methods (KPCA,KLDA). Correspondingly, a few approaches of classification algorithm are implemented: Support Vector Machine (SVM), Gaussian Quadratic Maximum Likelihood and K-nearest neighbors (KNN) and Gaussian Mixture Model(GMM).
Stars: ✭ 33 (-49.23%)
LdaLDA topic modeling for node.js
Stars: ✭ 262 (+303.08%)
SpidrA versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.
Stars: ✭ 656 (+909.23%)
LagoujobJob data mining repo for lagou.com
Stars: ✭ 256 (+293.85%)
WandThe ctypes-based simple ImageMagick binding for Python
Stars: ✭ 1,074 (+1552.31%)
ComicBookMakerScript to fetch webcomics and use them to create ebooks.
Stars: ✭ 27 (-58.46%)
Image processingHigh-level image processing wrapper for libvips and ImageMagick/GraphicsMagick
Stars: ✭ 600 (+823.08%)
ImageMagickThe Guide to ImageMagick
Stars: ✭ 25 (-61.54%)
Dutsso快速登录大连理工大学统一身份认证系统(SSO)的Python模块,可轻松实现成绩提醒、抢课、玉兰卡信息、个人信息查询等功能。
Stars: ✭ 32 (-50.77%)
Imagemagick🧙♂️ ImageMagick 7
Stars: ✭ 6,400 (+9746.15%)
AbotxCross Platform C# Web crawler framework, headless browser, parallel crawler. Please star this project! +1.
Stars: ✭ 63 (-3.08%)
Lightldafast sampling algorithm based on CGS
Stars: ✭ 49 (-24.62%)
Catimg🦦 Insanely fast image printing in your terminal
Stars: ✭ 880 (+1253.85%)
RmagickRuby bindings for ImageMagick
Stars: ✭ 576 (+786.15%)