GitPlanet

Cheap and reliable Node.js hosting starts at $3/month, and $1/month static HTML hosting

Created with love in Canada, visit hostnodejs.com today

Feel like to post an Ad? Learn Details
All Projects → codesofun → Web Bee

codesofun / Web Bee

Licence: mit
🐝 Web vertical crawler framework for fun

Programming Languages

java
68154 projects - #9 most used programming language

Labels

frameworkcrawler

Projects that are alternatives of or similar to Web Bee

Antch
Antch, a fast, powerful and extensible web crawling & scraping framework for Go
Stars: ✭ 198 (+7.61%)
Mutual labels:  crawler, framework
Creeper
🐾 Creeper - The Next Generation Crawler Framework (Go)
Stars: ✭ 762 (+314.13%)
Mutual labels:  crawler, framework
Colly
Elegant Scraper and Crawler Framework for Golang
Stars: ✭ 15,535 (+8342.93%)
Mutual labels:  crawler, framework
Webmagic
A scalable web crawler framework for Java.
Stars: ✭ 10,186 (+5435.87%)
Mutual labels:  crawler, framework
Sasila
一个灵活、友好的爬虫框架
Stars: ✭ 286 (+55.43%)
Mutual labels:  crawler, framework
Scrapy
Scrapy, a fast high-level web crawling & scraping framework for Python.
Stars: ✭ 42,343 (+22912.5%)
Mutual labels:  crawler, framework
Melody
🎶 Minimalist websocket framework for Go
Stars: ✭ 2,303 (+1151.63%)
Mutual labels:  framework
Crawler illegal cases in china
Collection of China illegal cases about web crawler 本项目用来整理所有中国大陆爬虫开发者涉诉与违规相关的新闻、资料与法律法规。致力于帮助在中国大陆工作的爬虫行业从业者了解我国相关法律，避免触碰数据合规红线。 [AD]中文知识图谱门户
Stars: ✭ 2,448 (+1230.43%)
Mutual labels:  crawler
Blitz
An eBook Framework (CSS + template)
Stars: ✭ 179 (-2.72%)
Mutual labels:  framework
Operatorkit
An opinionated Go framework for developing Kubernetes operators
Stars: ✭ 179 (-2.72%)
Mutual labels:  framework
Wq
📱🌐📋 wq: a modular framework supporting web / native geographic data collection apps for mobile surveys and citizen science. Powered by Django REST Framework, Redux, React, and Material UI.
Stars: ✭ 182 (-1.09%)
Mutual labels:  framework
Zhihu Crawler People
A simple distributed crawler for zhihu && data analysis
Stars: ✭ 182 (-1.09%)
Mutual labels:  crawler
Aws Serverless Data Lake Framework
Enterprise-grade, production-hardened, serverless data lake on AWS
Stars: ✭ 179 (-2.72%)
Mutual labels:  framework
Veranda
A graph editor framework for Unity
Stars: ✭ 180 (-2.17%)
Mutual labels:  framework
Middy
🛵 The stylish Node.js middleware engine for AWS Lambda
Stars: ✭ 2,592 (+1308.7%)
Mutual labels:  framework
Htframework
Unity HTFramework, a rapid development framework of client to the unity.
Stars: ✭ 179 (-2.72%)
Mutual labels:  framework
Haxegon
A haxe programming library for beginners. Powered by OpenFL and Starling.
Stars: ✭ 182 (-1.09%)
Mutual labels:  framework
Spring Vault
Provides familiar Spring abstractions for HashiCorp Vault
Stars: ✭ 179 (-2.72%)
Mutual labels:  framework
Pyui4win
一个用python实现业务逻辑、用xml和html/css/js描述界面的windows程序的快速开发框架。该框架将duilib运行时和python运行时结合到一起，实现用xml快速构建界面的同时，利用python及其众多久经考验的库编写业务逻辑，极大地缩短开发周期。
Stars: ✭ 180 (-2.17%)
Mutual labels:  framework
Gooact
⚛️ React done in 160 lines of JavaScript.
Stars: ✭ 182 (-1.09%)
Mutual labels:  framework
View All Similar Projects ➔

停止维护

Build Status Coverage Status DownloadsLicense Sauce Test Status

webBee 为乐趣而爬

  • webBee 基于jdk8 是一个持续成长的垂直爬虫框架项目

  • webBee 遵循MIT开源协议

  • webBee 是一个不错的java进阶项目

  • 欢迎大家贡献代码，如果觉得这个项目不错，请为它 点赞

演示站点

设计初衷

  • 设计简洁，面向接口
  • 配置简单，明了
  • 一次配置，自动匹配

涉及技术栈

  • httpcomponents
  • jsoup
  • redis
  • 代理
  • 多线程
  • 分布式爬取
  • 代理接口
  • 通过配置智能寻找目标 url
  • 图片、视频的处理

todo

  • 制作一个炫酷的官网实例

开源讨论群

  • 147255248 已解散

开源协议

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].