1128 Open source projects that are alternatives of or similar to Cocrawler

🍿爬虫代理IP池(proxy pool) python🍟一个还ok的IP代理池

稳健高效的评分制-针对性- IP代理池 + API服务，可以自己插入采集器进行代理IP的爬取，针对你的爬虫的一个或多个目标网站分别生成有效的IP代理数据库，支持MongoDB 4.0 使用 Python3.7（Scored IP proxy pool ,customise proxy data crawler can be added anytime）

爬取 www.mzitu.com 全站图片，截至目前共5162个图集，16.5万多张美女图片，使用 asyncio 和 aiohttp 实现的异步版本只需要不到2小时就能爬取完成。按日期创建图集目录，保存更合理。控制台只显示下载的进度条，详细信息保存在日志文件中。支持异常处理，不会终止爬虫程序。失败的请求，下次再执行爬虫程序时会自动下载

An easy to use, powerful crawler implemented in PHP. Can execute Javascript.

Web crawling framework based on asyncio.

Python3爬虫系列的理论验证，首先研究I/O模型，分别用Python实现了blocking I/O、nonblocking I/O、I/O multiplexing各模型下的TCP服务端和客户端。然后，研究同步I/O操作（依序下载、多进程并发、多线程并发）和异步I/O（asyncio）之间的效率差别

Crawl a website and take screenshots

Async Python 3.6+ web scraping micro-framework based on asyncio

一个获取知乎用户主页信息的多线程Python爬虫程序。

Declarative concurrency in Scala - The implementation of the chemical machine

An Android View with Gesture Supported for Painting

Concurrent wrappers for native Ruby IO & Sockets.

中国大陆大学列表爬虫

This repository is no longer maintained.

Implementation of blocking (IO-Bound) cancellable java.util.concurrent.CompletionStage and related extensions to java.util.concurrent.ExecutorService-s

Determine if a page may be crawled from robots.txt, robots meta tags and robot headers

mxget的Python实现

🚀 Complete Java - A to Z ║ 📚 Notes and Programs of all Important Concepts of Java - OOPS, Data Structures, Algorithms, Design Patterns & Development + Kotlin + Android 🔥

News, full-text, and article metadata extraction in Python 3. Advanced docs:

Enjoy driving on a Javascriptive (originally Pythonic) way to Japanese AV!

data resource untuk NLP bahasa indonesia

[not yet functional] Multi-threaded minecraft. Performance over correctness. What could go wrong?

Collection of Swift playgrounds used in my posts: From functional aspects of Swift to C interoperability.

The Floyd programming language

基于注解实现并行地依赖注入（数据聚合），可以看做 Spring Async 注解的升级版

The C++ Standard Library for Parallelism and Concurrency

[爬虫框架 (golang)] An awesome Go concurrent Crawler(spider) framework. The crawler is flexible and modular. It can be expanded to an Individualized crawler easily or you can use the default crawl components only.

Simple REST client for python 3.6+

대량의 뉴스 데이터를 수집하기 위해 만들어진 뉴스 크롤러입니다.

A complete set of primitives for concurrency and reactive programming on Swift

CLI for capturing website screenshots, powered by puppeteer.

Google play scraper for Python inspired by <facundoolano/google-play-scraper>

Python3 script to continuously download all images/webms of multiple 4chan thread simultaneously - without installation

Touhou Project random music video generator/player, crawling image and video from websites to generate MV.

🌈 Code samples of advanced features of Http4s in combination with some features of Fs2 not often seen.

Asynchronous Python client for InfluxDB

Website Cloner - Utilizes powerful Go routines to clone websites to your computer within seconds.

由Python编写的全异步实现的动漫之家(dmzj)漫画批量下载器（爬虫）

Asynchronous HTTP client/server framework for asyncio and Python

easyCV （video recorder and snapshot library,based on javaCV）基于javaCV的跨平台视频录像和基于FFmpeg的快照(截图)库

Plasma Programming Language

一些爬虫的代码

Weave loom fibers into your Clojure

A list of fancy questions I've been asked during the interviews I had. Some of them I ask when interviewing people.

Workflow based REST framework code generator

🖼️ A command-line system information tool written in bash 3.2+

A library for programatically capturing screenshots on Android

All in one tool for Information Gathering, Vulnerability Scanning and Crawling. A must have tool for all penetration testers

A screenshot plugin for electron

MM131网站图片爬取 🚨

Go process used to crawl websites

🔥 Shadowsocks 账号爬虫

To crawl all csgo skins from website.

Приложение для практического руководства по разработке бекенд-сервисов на Python (на основе вступительного испытания в Школу бэкенд‑разработки Яндекса)

Digger is a powerful and flexible web crawler implemented by pure golang

😱Full Automatic Amazon Distributed Spider | 亚马逊分布式四国际站采集选款产品|账号admin,密码adminadmin

Write "Concurrency" section of "A Tour of Go" in Haskell

微博超级话题爬虫，微博词频统计+情感分析+简单分类，新增肺炎超话爬取数据

RECIPE : high-performance, concurrent indexes for persistent memory (SOSP 2019)

jupiter是一个aio web框架，基于aiohttp。支持（restful格式、扫描注解、依赖注入、jinja2模板引擎、ORM框架）等。