All Projects → Scaleable Crawler With Docker Cluster → Similar Projects or Alternatives

1579 Open source projects that are alternatives of or similar to Scaleable Crawler With Docker Cluster

Titan
A Distributed Redis Protocol Compatible NoSQL Database
Stars: ✭ 1,050 (+993.75%)
Mutual labels:  distributed
Fair Analytics
📊 An analytics server that doesn't undermine user's privacy
Stars: ✭ 755 (+686.46%)
Mutual labels:  distributed
Weibo Album Crawler
新浪微博相册大图多线程爬虫。
Stars: ✭ 83 (-13.54%)
Mutual labels:  crawler
Kubernetes Gpu Guide
This guide should help fellow researchers and hobbyists to easily automate and accelerate there deep leaning training with their own Kubernetes GPU cluster.
Stars: ✭ 740 (+670.83%)
Mutual labels:  cluster
Dbblog
基于SpringBoot2.x+Vue2.x+ElementUI+Iview+Elasticsearch+RabbitMQ+Redis+Shiro的多模块前后端分离的博客项目
Stars: ✭ 1,045 (+988.54%)
Mutual labels:  rabbitmq
V2ray Web Manager
v2ray-web-manager 是一个v2ray的面板,也是一个集群的解决方案;同时增加了流量控制/账号管理/限速等功能。key: admin , panel ,web,cluster,集群,proxy
Stars: ✭ 738 (+668.75%)
Mutual labels:  cluster
Eventql
Distributed "massively parallel" SQL query engine
Stars: ✭ 1,121 (+1067.71%)
Mutual labels:  distributed
Cookedrabbit
CookedRabbit is a simple service based RabbitMQ wrapper for dealing with channels/connections.
Stars: ✭ 28 (-70.83%)
Mutual labels:  rabbitmq
Hmq
High performance mqtt broker
Stars: ✭ 722 (+652.08%)
Mutual labels:  cluster
Gf Secrets
Secret and/ credential patterns used for gf.
Stars: ✭ 96 (+0%)
Mutual labels:  crawler
Framework
The Framework is a set of components and tools which brings the user an interface (GUI / API) to setup, extend and manage an Open vStorage platform.
Stars: ✭ 27 (-71.87%)
Mutual labels:  celery
Modin
Modin: Speed up your Pandas workflows by changing a single line of code
Stars: ✭ 6,639 (+6815.63%)
Mutual labels:  distributed
Node Server Project
基于 node.js + express 技术栈,采用MVC结构设计、JWT + RESTful API、PM2服务监控的Node服务器端项目框架.
Stars: ✭ 47 (-51.04%)
Mutual labels:  rabbitmq
Storm Crawler
A scalable, mature and versatile web crawler based on Apache Storm
Stars: ✭ 703 (+632.29%)
Mutual labels:  distributed
Flowr
Robust and efficient workflows using a simple language agnostic approach
Stars: ✭ 73 (-23.96%)
Mutual labels:  cluster
Bifrost
Bifrost ---- 面向生产环境的 MySQL 同步到Redis,MongoDB,ClickHouse,MySQL等服务的异构中间件
Stars: ✭ 701 (+630.21%)
Mutual labels:  rabbitmq
Docker Redis Cluster
Dockerfile for Redis Cluster (redis 3.0+)
Stars: ✭ 1,035 (+978.13%)
Mutual labels:  cluster
Arq
Fast job queuing and RPC in python with asyncio and redis.
Stars: ✭ 695 (+623.96%)
Mutual labels:  distributed
Clutter
Fully distributed twitter built on holochain
Stars: ✭ 84 (-12.5%)
Mutual labels:  distributed
Xalpha
基金投资管理回测引擎
Stars: ✭ 683 (+611.46%)
Mutual labels:  crawler
Social Scraper
Tổng hợp script crawl dữ liệu từ các mạng xã hội & website tiếng Việt
Stars: ✭ 47 (-51.04%)
Mutual labels:  crawler
Node
Mysterium Network Node - official implementation of distributed VPN network (dVPN) protocol
Stars: ✭ 681 (+609.38%)
Mutual labels:  distributed
Dubbo Trace
基于Dubbo的分布式系统调用跟踪Demo
Stars: ✭ 72 (-25%)
Mutual labels:  distributed
Grab Site
The archivist's web crawler: WARC output, dashboard for all crawls, dynamic ignore patterns
Stars: ✭ 680 (+608.33%)
Mutual labels:  crawler
Lemon Rabbitmq
乐檬框架之rabbitMQ的解耦实现方式(基于springboot框架),利用ConfirmCallback确保消息安全发送至broker服务器,使用Ack/Nack手动确认消息处理状态,保证broker消息被正确消费
Stars: ✭ 46 (-52.08%)
Mutual labels:  rabbitmq
Crc
Red Hat CodeReady Containers is a tool that manages a local OpenShift 4.x cluster optimized for testing and development purposes
Stars: ✭ 676 (+604.17%)
Mutual labels:  cluster
Dat Keyserver
a distributed PGP keyserver project based on the dat protocol
Stars: ✭ 89 (-7.29%)
Mutual labels:  distributed
Postgrest Starter Kit
Starter Kit and tooling for authoring REST API backends with PostgREST
Stars: ✭ 657 (+584.38%)
Mutual labels:  rabbitmq
Fgbase
Ready-send coordination layer on top of goroutines.
Stars: ✭ 45 (-53.12%)
Mutual labels:  distributed
Jboot
一个优雅的微服务框架,SpringCloud 之外的另一个选择,已经使用在用户量过亿的商业产品上,有超过1000家公司在使用Jboot做极速开发...
Stars: ✭ 655 (+582.29%)
Mutual labels:  rabbitmq
Storj
Ongoing Storj v3 development. Decentralized cloud object storage that is affordable, easy to use, private, and secure.
Stars: ✭ 1,278 (+1231.25%)
Mutual labels:  distributed
Bunny
Bunny is a popular, easy to use, mature Ruby client for RabbitMQ
Stars: ✭ 1,224 (+1175%)
Mutual labels:  rabbitmq
Terpene Profile Parser For Cannabis Strains
Parser and database to index the terpene profile of different strains of Cannabis from online databases
Stars: ✭ 63 (-34.37%)
Mutual labels:  crawler
Orleans.providers.rabbitmq
Orleans providers for RabbitMQ.
Stars: ✭ 27 (-71.87%)
Mutual labels:  rabbitmq
Dbfs
Distributed Blockchain-based File Storage 📡
Stars: ✭ 45 (-53.12%)
Mutual labels:  cluster
Practical.cleanarchitecture
Asp.Net Core 5 Clean Architecture (Microservices, Modular Monolith, Monolith) samples (+Blazor, Angular 11, React 17, Vue 2.6), Domain-Driven Design, CQRS, Event Sourcing, SOLID, Asp.Net Core Identity Custom Storage, Identity Server 4 Admin UI, Entity Framework Core, Selenium E2E Testing, SignalR Notification, Hangfire Tasks Scheduling, Health Checks, Security Headers, ...
Stars: ✭ 639 (+565.63%)
Mutual labels:  rabbitmq
Geziyor
Geziyor, a fast web crawling & scraping framework for Go. Supports JS rendering.
Stars: ✭ 1,246 (+1197.92%)
Mutual labels:  crawler
Scrapyrt
HTTP API for Scrapy spiders
Stars: ✭ 637 (+563.54%)
Mutual labels:  crawler
Eventd
A simple daemon to track remote or local events and do actions the user wants to
Stars: ✭ 43 (-55.21%)
Mutual labels:  distributed
Price Monitor
京东商品价格监控:监控用户设定商品价格,降价邮件/微信提醒。技术:Python爬虫/IP代理池/JS接口爬取/Selenium页面爬取
Stars: ✭ 634 (+560.42%)
Mutual labels:  crawler
Jd Autobuy
Python爬虫,京东自动登录,在线抢购商品
Stars: ✭ 1,174 (+1122.92%)
Mutual labels:  crawler
Amqp
EventMachine-based RabbitMQ client. Prefer Bunny: http://rubybunny.info. See documentation guides at http://rubyamqp.info.
Stars: ✭ 631 (+557.29%)
Mutual labels:  rabbitmq
Phalcon Vm
Vagrant configuration for PHP7, Phalcon 3.x and Zephir development.
Stars: ✭ 43 (-55.21%)
Mutual labels:  rabbitmq
Xxl Conf
A lightweight distributed configuration management platform. (分布式配置管理平台XXL-CONF)
Stars: ✭ 619 (+544.79%)
Mutual labels:  distributed
Hazelcast Python Client
Hazelcast IMDG Python Client
Stars: ✭ 92 (-4.17%)
Mutual labels:  distributed
H2o 3
H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc.
Stars: ✭ 5,656 (+5791.67%)
Mutual labels:  distributed
Xfailovercluster
This module contains DSC resources for deployment and configuration of Windows Server Failover Cluster.
Stars: ✭ 42 (-56.25%)
Mutual labels:  cluster
Datafusion
DataFusion has now been donated to the Apache Arrow project
Stars: ✭ 611 (+536.46%)
Mutual labels:  cluster
Scrapy Examples
Some scrapy and web.py exmaples
Stars: ✭ 71 (-26.04%)
Mutual labels:  crawler
Aio Pika
AMQP 0.9 client designed for asyncio and humans.
Stars: ✭ 611 (+536.46%)
Mutual labels:  rabbitmq
Avbook
AV 电影管理系统, avmoo , javbus , javlibrary 爬虫,线上 AV 影片图书馆,AV 磁力链接数据库,Japanese Adult Video Library,Adult Video Magnet Links - Japanese Adult Video Database
Stars: ✭ 8,133 (+8371.88%)
Mutual labels:  crawler
Driveway
pure CSS masonry layouts
Stars: ✭ 607 (+532.29%)
Mutual labels:  cluster
Taiwan News Crawlers
Scrapy-based Crawlers for news of Taiwan
Stars: ✭ 83 (-13.54%)
Mutual labels:  crawler
Bibi
An e-commerce fullstack solution for Flask 出口电商全栈解决方案
Stars: ✭ 914 (+852.08%)
Mutual labels:  celery
Slurm In Docker
Slurm in Docker - Exploring Slurm using CentOS 7 based Docker images
Stars: ✭ 63 (-34.37%)
Mutual labels:  cluster
Distributed
Stars: ✭ 913 (+851.04%)
Mutual labels:  distributed
Autooffload.jl
Automatic GPU, TPU, FPGA, Xeon Phi, Multithreaded, Distributed, etc. offloading for scientific machine learning (SciML) and differential equations
Stars: ✭ 21 (-78.12%)
Mutual labels:  distributed
Wombat
Lightweight Ruby web crawler/scraper with an elegant DSL which extracts structured data from pages.
Stars: ✭ 1,220 (+1170.83%)
Mutual labels:  crawler
Rabbitmq Common
Common library used by rabbitmq-server and rabbitmq-erlang-client
Stars: ✭ 62 (-35.42%)
Mutual labels:  rabbitmq
Papercrawler
Crawler used to crawl papers
Stars: ✭ 20 (-79.17%)
Mutual labels:  crawler
301-360 of 1579 similar projects