472 Open source projects that are alternatives of or similar to Xehentai

Script that crawls meta data from ICLR OpenReview webpage. Tutorials on installing and using Selenium and ChromeDriver on Ubuntu.

line-bot-tutorial use python flask

台灣股票即時爬蟲。Taiwan Stock Exchange Real Time Crawler

Pure Go WebRTC SFU

LinkedIn Scraper (currently working 2020)

This is a Multi-thread crawler for Tumblr.

Fresh Onions is an open source TOR spider / hidden service onion crawler hosted at zlal32teyptf4tvi.onion

🍭 epub generator for (light)novels (轻) 小说 epub 生成器，支持站点：轻之国度、轻小说文库

What do people have in their dotfiles?

A fast tool to fetch URLs from HTML attributes by crawl-in.

swiss army knife for hackers

JSON-RPC server based on C++11 and libevent

Declarative web scraping

我的爬虫合集

快速、简洁且强大的PHP爬虫框架

python requests + Django+ nodejs koa+ mysql to crawl eastmoney fund and stock data,for data analysis and visualiaztion .

Core part of NewPipe

Just a crawler based on tg-cli for Telegram. Deprecated by now, please use telegram-export.

🌭💦 91porn爬虫在线无限制API接口（永久有效，口令每日更新） 及 在线web预览

读书笔记《自己动手写网络爬虫》，自己敲的代码。主要记录了网络爬虫的基本实现，网页去重的算法，网页指纹算法，文本信息挖掘

Crawl BookCorpus

A fluent and functional approach to querying HTML

A Smart, Automatic, Fast and Lightweight Web Scraper for Python

Crawl a website and take screenshots

👩 美女写真套图爬虫（一）

TumblTwo, an Improved Fork of TumblOne, a Tumblr Downloader.

台灣上市上櫃股票爬蟲 Taiwan Stock Exchange Crawler

一个轻量级、快速、多线程、多管道、灵活配置的网络爬虫。

A collection of awesome web crawler,spider in different languages

Videodl: A lightweight video downloader written by pure python.

Android 本地网络小说爬虫，基于jsoup及xpath

tw.pycon.org/2017/events/talk/314386410792550475/

🍻 bilibili video (including bangumi) and danmaku downloader | B站视频（含番剧）、弹幕下载器

无cookie版微博爬虫，可以连续爬取一个或多个新浪微博用户信息、用户微博及其微博评论转发。

A web crawler. Supercrawler automatically crawls websites. Define custom handlers to parse content. Obeys robots.txt, rate limits and concurrency limits.

🐤️ Lost Ark wait notifier

Html网页正文提取

A simple JSON-RPC for aiohttp

The fastest dork scanner written in Go.

PTT 網路版爬蟲

Script that crawls meta data from ICLR OpenReview webpage. Tutorials on installing and using Selenium and ChromeDriver on Ubuntu.

Practical pinned gist which show your latest medium status 📌

Crawl GitHub APIs and store the discovered orgs, repos, commits, ...

JSON-RPC 2.0 server and client library, with HTTP (with Websocket support) and TCP endpoints

Crawler for Nintendo Switch eShop

High performance crawler for Nodejs

微信公众号爬虫，公众号历史文章，文章评论，文章阅读及在看数据，可视化web页面，可部署于Windows服务器。基于Python3之flask/mysql/redis/mitmproxy/pywin32等实现，高效微信爬虫，微信公众号爬虫，历史文章，文章评论，数据更新。

Continuous scalable web crawler built on top of Flink and crawler-commons

新一代爬虫平台，以图形化方式定义爬虫流程，不写代码即可完成爬虫。

A simple and flexible web crawler framework for java.

一个灵活、友好的爬虫框架

练习NLP，分析淘宝评论的项目

爬取菜鸟教程网站并转PDF__python_crawer_by_chrome

爬蟲極簡教學（fetch, parse, search, multiprocessing, API）- PTT 為例

a new crawler based on python with more function including Network fingerprint search

🐨实时监控1000家中国企业的新闻动态

Elegant Web3js functionality in Swift. Native ABI parsing and smart contract interactions on Ethereum network.

本项目不再维护，详情可加群了解 https://t.me/onecomicbook

🔁 JSON-RPC 1/2 transport implementation. Supports python 2/3 and pypy.

📰 A responsive interface of Hacker News with summaries and thumbnails.