563 Open source projects that are alternatives of or similar to Comicbook

读书笔记《自己动手写网络爬虫》，自己敲的代码。主要记录了网络爬虫的基本实现，网页去重的算法，网页指纹算法，文本信息挖掘

简单易用的Python爬虫框架，QQ交流群：597510560

A Kotlin wrapper for Jikan REST API

A php crawler that finds emails on the internets

Crawl GitHub APIs and store the discovered orgs, repos, commits, ...

Xenomorph Crawler, a Concise, Declarative and Observable Distributed Crawler(Node / Go / Java / Rust) For Web, RDB, OS, also can act as a Monitor(with Prometheus) or ETL for Infrastructure 💫 多语言执行器，分布式爬虫

Unofficial fork of Tachiyomi for anime

A Moodle downloader that downloads course content fast from Moodle (eg. lecture pdfs)

A fluent and functional approach to querying HTML

一些非常有趣的python爬虫例子,对新手比较友好,主要爬取淘宝、天猫、微信、豆瓣、QQ等网站。(Some interesting examples of python crawlers that are friendly to beginners. )

A Secured RESTful API Service for Manga

java framework for prerender

Core part of NewPipe

B站用户爬虫 好耶~是爬虫

Collection of Padoru Images

o'taku is an application that allows you to find functional streaming links for your favorite anime. This project aims to simplify the tracking of a particular anime. Indeed, when you search for an anime, you will receive a lot of information about it, but also, a list of streaming links available in several languages.

爬取北大法宝网http://www.pkulaw.cn/Case/

Image Viewer and Endless Scroll userscripts for Gelbooru and various other boorus

GraphQuery is a query language and execution engine tied to any backend service.

微信公众号爬虫，公众号历史文章，文章评论，文章阅读及在看数据，可视化web页面，可部署于Windows服务器。基于Python3之flask/mysql/redis/mitmproxy/pywin32等实现，高效微信爬虫，微信公众号爬虫，历史文章，文章评论，数据更新。

Node.js scraper to get data from Google Play

A simple manga hosting CMS written in Django

pylinkvalidator is a standalone and pure python link validator and crawler that traverses a web site and reports errors (e.g., 500 and 404 errors) encountered.

Crawl a website and take screenshots

An automated website accessibility scanner and cli

API wrapper for MangaDex v5 API.

Scrapy, a fast high-level web crawling & scraping framework for Python.

Crawler (Bot) searching for credential leaks on different paste sites.

A web crawler (for bug hunting) that gathers more than you can imagine.

Download manga you rent from http://renta.papy.co.jp/

TumblTwo, an Improved Fork of TumblOne, a Tumblr Downloader.

A dungeon crawler

뉴토끼 / 마나토끼 앱

一个灵活、友好的爬虫框架

Crawler for LinkedIn full profiles 2019

TriviaBot: Play trivia in Discord! Powered by discord.js and OpenTDB, with 24 categories and three modes of play.

GOPA, a spider written in Go.（NOTE: this project moved to https://github.com/infinitbyte/gopa ）

一个轻量级、快速、多线程、多管道、灵活配置的网络爬虫。

Amazon商品引流的 python 爬虫

[WIP] 1.x app rewrite

a scaleable and efficient crawelr with docker cluster , crawl million pages in 2 hours with a single machine

Script that crawls meta data from ICLR OpenReview webpage. Tutorials on installing and using Selenium and ChromeDriver on Ubuntu.

Secret and/ credential patterns used for gf.

This repo is a fork of Difegue / LANraragi , those things i've done was to translate this repo into chinese ,and fix chrome browser js problem.

利用文本挖掘技术进行新闻热点关注问题分析

Videodl: A lightweight video downloader written by pure python.

爬虫代理IP池服务，可供其他爬虫程序通过restapi获取

Manage & read your comics

Geziyor, a fast web crawling & scraping framework for Go. Supports JS rendering.

爬蟲極簡教學（fetch, parse, search, multiprocessing, API）- PTT 為例

Terminal client for MangaDex 📖

🕷️ A node crawler for github trending.

Python爬虫代理IP池(proxy pool)

An API that lets you fetch user lists from MyAnimeList.

Anime Watcher, Manga Reader, and Novel Reader as three separate apps, same UI

Web crawling framework based on asyncio.

Crawl some picture for fun

Plex Channel to view Anime, Asian Drama, Cartoons, Manga & Comics from KissAnime, KissAsian, KissCartoon, KissManga & ReadComicOnline

Script that generates a sitemap by crawling a given URL