2308 Open source projects that are alternatives of or similar to Gerapy

Backend para coleta e disponibilização dos dados 📜

收集各种免费的 Python 爬虫项目

feapder是一款支持分布式、批次采集、任务防丢、报警丰富的python爬虫框架

😩Tool For Taobao/Tmall| 儿时玩具已经过时

all kinds of scrapy demo

A collection of awesome web scaper, crawler.

Free proxy server, continuously crawling and providing proxies, based on Tornado and Scrapy. 免费代理服务器，基于Tornado和Scrapy，在本地搭建属于自己的代理池

A python web scraper for public email lists.

Python爬虫实战 - 模拟登陆各大网站 包含但不限于：滑块验证、拼多多、美团、百度、bilibili、大众点评、淘宝，如果喜欢请start ❤️

ScrapingOutsourcing专注分享爬虫代码 尽量每周更新一个

💐Marmot | Web Crawler/HTTP protocol Download Package 🐭

Django based application that allows creating, deploying and running Scrapy spiders in a distributed manner

Lite version of Crawlab. 轻量版 Crawlab 爬虫管理平台

一个基于Scrapy的数据采集爬虫代码库

Iota is a web scraper which can find all of the images and links/suburls on a webpage

Dynamic configurable crawl (动态可配置化爬虫)

招聘网数据爬虫

免费 IP 代理池。Scrapy 爬虫框架插件

🎊 Design and implement of lightweight crawler framework.

A series of distributed components for Scrapy. Including RabbitMQ-based components, Kafka-based components, and RedisBloom-based components for Scrapy.

Jet Bridge (Django) for Jet Admin – Admin panel framework for your application

🔧 🔩 🔨 收集整理了爬虫相关的工具、模拟登陆技术、代理IP、scrapy模板代码等内容。

Download images from Google, Bing, Baidu. 谷歌、百度、必应图片下载.

A lite distributed Java spider framework :-)

Online web application-dashboard for report analyzing,running and online monitoring of load tests started with JMeter

🥄 A package for building specific Proxy Pool for different Sites.

Redis管理平台Repoll，现已开源，基于redis3.x，支持单机、哨兵以及集群模式

JavaScript + BeautifulSoup = JSSoup

🍿爬虫代理IP池(proxy pool) python🍟一个还ok的IP代理池

用diango开发的shadowsocks/V2ray面板

一个功能全面的微信读书爬虫 wereader

An implementation of Django's EmailBackend compatible with sendgrid-python v5+

Lingvo

Distributed compute platform implemented in Rust, and powered by Apache Arrow.

Django registration and authentication with GraphQL.

This app makes it extremely easy to build Django powered SPA's (Single Page App) or Mobile apps exposing all registration and authentication related functionality as CBV's (Class Base View) and REST (JSON)

🐠 Dashing dashboard for Home Assistant (deprecated)

Django Static Precompiler provides template tags and filters to compile CoffeeScript, LiveScript, SASS / SCSS, LESS, Stylus, Babel and Handlebars. It works with both inline code and external files.

Django Channels based WebSocket GraphQL server with Graphene-like subscriptions

Free RTL Bootstrap 3 Admin Template

🚀 Forum app built in React, Redux & Django

shows a 503 error page when maintenance-mode is on. 🚧 🛠

稳健高效的评分制-针对性- IP代理池 + API服务，可以自己插入采集器进行代理IP的爬取，针对你的爬虫的一个或多个目标网站分别生成有效的IP代理数据库，支持MongoDB 4.0 使用 Python3.7（Scored IP proxy pool ,customise proxy data crawler can be added anytime）

A framework to build Slack apps using Python

HTML5 SQL Server Integration Services Dashboard

Material Design for Django

A django app that builds item-based suggestions for users.

Dashing dashboard for Icinga 2 using the REST API

🕷️ The progressive PHP crawler framework! 优雅的渐进式PHP采集框架。

Tensorflow in Docker on Mesos #tfmesos #tensorflow #mesos

Yii2 REST API + Angular10 Boilerplate (Frontend/Backend)

CSDN 资源下载器

SaaS base application (Flask, Vue, Bootstrap, Webpack)

On-device CocoaLumberjack console with support for search, adjust levels, copying and more.

多线程知乎用户爬虫，基于python3

💂🏻 Django package that provides hints to optimize database usage by deferring unused fields (and more)

📪 An interactive emailing management service with scheduling, templating, tracking and A/B testing.

Easily integrate common behaviors for Django models, e.g. Timestamps, Publishing, Authoring, Editing and more.

OAuth2 goodies for the Djangonauts!

Django-environ allows you to utilize 12factor inspired environment variables to configure your Django application.