533 Open source projects that are alternatives of or similar to Crawler_illegal_cases_in_china

中国法研杯-司法人工智能挑战赛

爬蟲極簡教學（fetch, parse, search, multiprocessing, API）- PTT 為例

Cookie 🍪 Consent module for Angular.

2021中国翻墙软件和科学上网推荐指南，最新稳定好用的翻墙VPN推荐，能用的VPN梯子不多了，以及对比VPS自建梯子、SSR机场、V2ray、蓝灯、老王VPN、WireGuard等翻墙软件和科学上网方法。

Beanbun 是用 PHP 编写的多进程网络爬虫框架，具有良好的开放性、高可扩展性，基于 Workerman。

📰 A responsive interface of Hacker News with summaries and thumbnails.

Touhou Project random music video generator/player, crawling image and video from websites to generate MV.

trying to be a user-friendly and hackable music player

A powerful dynamic crawler for web vulnerability scanners

An R web crawler and scraper

A php crawler that finds emails on the internets

line-bot-tutorial use python flask

metoo in china

Update Version of weibo_terminator, This is Workflow Version aim at Get Job Done!

A cross platform UI crawler which scans view trees then generate and execute UI test cases.

The simple, easy to use command line web crawler.

哔咔漫画收藏夹下载程序

A fast tool to fetch URLs from HTML attributes by crawl-in.

Xenomorph Crawler, a Concise, Declarative and Observable Distributed Crawler(Node / Go / Java / Rust) For Web, RDB, OS, also can act as a Monitor(with Prometheus) or ETL for Infrastructure 💫 多语言执行器，分布式爬虫

模拟登录各类网站，操作 API 完成各种不可描述的事情

This package is a complete tool for creating a large dataset of images (specially designed -but not only- for machine learning enthusiasts). It can crawl the web, download images, rename / resize / covert the images and merge folders..

我的爬虫合集

Go process used to crawl websites

C#命名规范中文版/C#编码规范中文版

Get the lyrics for the song currently playing on Spotify

(China) 1. MySQL 身份证 地区 数据库(包含已被合并的区县,详见README) 2. PHP 验证身份证号是否正确 3. 从身份证号中获取 性别 生日 年龄 出生地 等信息 4.路过留个star

A Moodle downloader that downloads course content fast from Moodle (eg. lecture pdfs)

V2ray看新闻，自动抓取可用节点，以V2ray的机制上网看新闻

Tổng hợp script crawl dữ liệu từ các mạng xã hội & website tiếng Việt

读书笔记《自己动手写网络爬虫》，自己敲的代码。主要记录了网络爬虫的基本实现，网页去重的算法，网页指纹算法，文本信息挖掘

ScrapingOutsourcing专注分享爬虫代码 尽量每周更新一个

A fluent and functional approach to querying HTML

新浪微博爬虫，用python爬取新浪微博数据，并下载微博图片和微博视频

Crawl a website and take screenshots

中华人民共和国行政区划：省级（省份直辖市自治区）、 地级（城市）、 县级（区县）、 乡级（乡镇街道）、 村级（村委会居委会） ，中国省市区镇村二级三级四级五级联动地址数据。

An Innovative Salient Object Detection Using Center-Dark Channel Prior

AV 电影管理系统， avmoo , javbus , javlibrary 爬虫，线上 AV 影片图书馆，AV 磁力链接数据库，Japanese Adult Video Library,Adult Video Magnet Links - Japanese Adult Video Database

TumblTwo, an Improved Fork of TumblOne, a Tumblr Downloader.

data resource untuk NLP bahasa indonesia

一个轻量级、快速、多线程、多管道、灵活配置的网络爬虫。

vulnx 🕷️ is an intelligent bot auto shell injector that detect vulnerabilities in multiple types of cms { `wordpress , joomla , drupal , prestashop .. `}

Videodl: A lightweight video downloader written by pure python.

Sample of using proxies to crawl baidu search results.

tw.pycon.org/2017/events/talk/314386410792550475/

Discover hidden deepweb pages

无cookie版微博爬虫，可以连续爬取一个或多个新浪微博用户信息、用户微博及其微博评论转发。

🕵️‍♂️ LinkedIn profile scraper returning structured profile data in JSON. Works in 2020.

🐤️ Lost Ark wait notifier

🔍 简单的搜索引擎, django 框架

🤖 Prerendering for JavaScript powered websites. Great solution for PWAs (Progressive Web Apps), SPAs (Single Page Applications), and other websites based on top of front-end JavaScript frameworks

java framework for prerender

蓝天采集器是一款免费的数据采集发布爬虫软件，采用php+mysql开发，可部署在云服务器，几乎能采集所有类型的网页，无缝对接各类CMS建站程序，免登录实时发布数据，全自动无需人工干预！是网页大数据采集软件中完全跨平台的云端爬虫系统

Elasticsearch File System Crawler (FS Crawler)

c++11 thread pool

🇨🇳最全最新中国【省、市、区县、乡镇街道】json,csv,sql数据

最新中国地图json文件，可用d3开发中国地图

Crawl instagram photos, posts and videos for download.

leaflet 加载百度瓦片地图图层 以及高德 、天地图等国内常用地图

Python爬虫代理IP池(proxy pool)

📅🇨🇳 中国法定节假日数据 自动每日抓取国务院公告