1331 Open source projects that are alternatives of or similar to Spider_job

A series of distributed components for Scrapy. Including RabbitMQ-based components, Kafka-based components, and RedisBloom-based components for Scrapy.

Free proxy server, continuously crawling and providing proxies, based on Tornado and Scrapy. 免费代理服务器，基于Tornado和Scrapy，在本地搭建属于自己的代理池

admin ui for scrapy/open source scrapinghub

lots of spider (很多爬虫）

收集各种免费的 Python 爬虫项目

JSpider会每周更新至少一个网站的JS解密方式，欢迎 Star，交流微信：13298307816

feapder是一款支持分布式、批次采集、任务防丢、报警丰富的python爬虫框架

Python爬虫实战 - 模拟登陆各大网站 包含但不限于：滑块验证、拼多多、美团、百度、bilibili、大众点评、淘宝，如果喜欢请start ❤️

ScrapingOutsourcing专注分享爬虫代码 尽量每周更新一个

Getting started with Puppeteer and Chrome Headless for Web Scraping

Clojure News Web Application - (Hacker News Clone)

Instant Graphql for MongoDb (active branch is golang, rewrite in process)

This is an Open Source PHP Reporting Framework which you can use to write perfect data reports or to construct awesome dashboards using PHP

微服务 spring dubbo项目：dubbo rpc；druid数据源连接池；mybatis配置集成，多数据源；jmx监控MBean；定时任务；aop；ftp；测试；Metrics监控；参数验证；跨域处理；shiro权限控制；consul服务注册，发现；redis分布式锁；SPI服务机制；cat监控；netty服务代理；websocket；disconf；mongodb集成；rest；docker；fescar

HTTP-based JSON storage.

Real Time Big Data / IoT Machine Learning (Model Training and Inference) with HiveMQ (MQTT), TensorFlow IO and Apache Kafka - no additional data store like S3, HDFS or Spark required

Perl driver for the MongoDB

Article publishing platform that automatically distributes your articles to various media channels

JavaScript + BeautifulSoup = JSSoup

Node.js基础与应用教程，适合初学者入门，以及有一定经验的开发者提高。Node.js全栈交流QQ群：423652352，node.js或者全栈开发培训QQ群：579500717

Repositório oficial do livro: Construindo APIs testáveis com Node.js

A monorepo that holds all of Foursquare's opensource projects

🎉Koa + GraphQL + Apollo-Server demo

Build your own SaaS business with SaaS boilerplate. Productive stack: React, Material-UI, Next, MobX, WebSockets, Express, Node, Mongoose, MongoDB. Written with TypeScript.

🕷️ The progressive PHP crawler framework! 优雅的渐进式PHP采集框架。

Exercises for the Full Stack Open course.

AngularJS 2 (Updated to 4.2.0) Mean Stack application which uses Angular2, Gulp, Express, Node, MongoDB (Mongoose) with Repository Pattern Business Layer

多线程知乎用户爬虫，基于python3

Nestjs Starter using Mongodb and Passportjs

京东口罩库存监控爬虫(非selenium)，扫码登录、查价、加购、下单、秒杀

🔥 vue + koa + mongodb 搭建 mobile web 商城 （End。。。）

A fast and powerfull dashboard (admin) finder

Open-source web platform for creating charts out of different data sources (databases and APIs) 📈📊

😄 基于vue全家桶、nodejs和mongodb的前后端整合项目

portia-dashboard is a visual web crawler based on scrapinghub/portia

pac4j security library for Spring Security: OAuth, CAS, SAML, OpenID Connect, LDAP, JWT...

Dynamic file detection tool based on crawler 基于爬虫的动态敏感文件探测工具

Python AI assistant 🧠

Helical Insight software is world’s first Open Source Business Intelligence framework which helps you to make sense out of your data and make well informed decisions.

基于vue和iview的后台管理系统

MyBlog

Web crawler.

Yorkie is a document store for collaborative applications.

DEPRECATED

Easy, powerful and ultrafast MongoDB ODM for Laravel.

LSpider 一个为被动扫描器定制的前端爬虫

Telegram Bot @RastreioBot

🍿爬虫代理IP池(proxy pool) python🍟一个还ok的IP代理池

Easy does it

Sample ToDo application (various languages) running on IBM Cloud

High performance datastore for time series and tick data

Learn Clean Architecture with .NET Core 3.0 🔥

Course demos and handout material for Talk Python's MongoDB Quickstart course

Bilibili.com视频批量下载工具包

🚧 Project moved, see Aqua and Frame

A simple jobs queue that just works (for Meteor.js)

Open-Source, collaborative, digital Whiteboard

MongoDB adapter for Casbin

A MERN stack based online marketplace application [Full-Stack React Projects]

Full Reactive Stack with Spring Boot (WebFlux), MongoDB and Angular