young-crawler
scala结合actor编写的分布式网络爬虫,实现上采用Akka 异步消息处理框架,无阻塞,性能高,网页爬取速度快 #如何启动 下载项目后配置cralwer.properties,详细配置文件里有注释
yangwx1402 / young-crawler
Licence: other
scala结合actor编写的分布式网络爬虫
Stars: ✭ 15
Programming Languages
scala
5932 projects
HTML
75241 projects
java
68154 projects - #9 most used programming language
javascript
184084 projects - #8 most used programming language
Projects that are alternatives of or similar to young-crawler
akka-periscope
Akka plugin to collect various data about actors
Stars: ✭ 16 (+6.67%)
Mutual labels: akka, actor
Otoroshi
Lightweight api management on top of a modern http reverse proxy
Stars: ✭ 177 (+1080%)
Mutual labels: akka
Cookim
Distributed web chat application base websocket built on akka.
Stars: ✭ 198 (+1220%)
Mutual labels: akka
imdb-spider
scrapy spider for scraping imdb {movie_id: [recommended, ...]}
Stars: ✭ 23 (+53.33%)
Mutual labels: spider
Lighthouse
Lighthouse - a simple service discovery platform for Akka.Cluster (Akka.NET)
Stars: ✭ 164 (+993.33%)
Mutual labels: akka
Akka Kryo Serialization
Kryo-based serialization for Akka
Stars: ✭ 229 (+1426.67%)
Mutual labels: akka
Kafka With Akka Streams Kafka Streams Tutorial
Code samples for the Lightbend tutorial on writing microservices with Akka Streams, Kafka Streams, and Kafka
Stars: ✭ 204 (+1260%)
Mutual labels: akka
Powerjob
Enterprise job scheduling middleware with distributed computing ability.
Stars: ✭ 3,231 (+21440%)
Mutual labels: akka
Jvm Bloggers
JVM Bloggers - website and newsletter with JVM blogs from Poland
Stars: ✭ 193 (+1186.67%)
Mutual labels: akka
akka-persistence-s3
akka-persistence journal/snapshot plugin for AWS S3(support aws sdk for java v2)
Stars: ✭ 19 (+26.67%)
Mutual labels: akka
Constructr
Coordinated (etcd, ...) cluster construction for dynamic (cloud, containers) environments
Stars: ✭ 219 (+1360%)
Mutual labels: akka
Note that the project description data, including the texts, logos, images, and/or trademarks,
for each open source project belongs to its rightful owner.
If you wish to add or remove any projects, please contact us at [email protected].