533 Open source projects that are alternatives of or similar to Crawler_illegal_cases_in_china

[爬虫框架 (golang)] An awesome Go concurrent Crawler(spider) framework. The crawler is flexible and modular. It can be expanded to an Individualized crawler easily or you can use the default crawl components only.

A list of companies of China currently using Elixir in production

This repository hosts the project for open-source hummingbird E203 RISC processor Core.

scrapes medias, likes, followers, tags and all metadata. Inspired by instagram-php-scraper,bot

一个获取知乎用户主页信息的多线程Python爬虫程序。

疫情数据爬虫，2019新型冠状病毒数据仓库，轨迹数据，同乘数据，报道

Python3 script to continuously download all images/webms of multiple 4chan thread simultaneously - without installation

根据关键词抓取微博数据，再生成词云

News, full-text, and article metadata extraction in Python 3. Advanced docs:

Crawl some picture for fun

All in one tool for Information Gathering, Vulnerability Scanning and Crawling. A must have tool for all penetration testers

Dynamic meta tags in your AngularJS single page application

Digger is a powerful and flexible web crawler implemented by pure golang

네이버 뉴스 수집을 위한 도구

微博超级话题爬虫，微博词频统计+情感分析+简单分类，新增肺炎超话爬取数据

📢 Ptt 文章通知機器人！Notify Ptt Article in Realtime

⚠️ [Deprecated] No longer maintained. A simple jQuery plugin for picking provinces, cities and districts of China. (中国 / 省市区 / 三级联动 / 地址选择器)

抖音爬虫，tiktok crawler，抖音数据采集接口，抖音视频去水印，百分百成功，不需要服务器，不需要代理 IP。

Squidwarc is a high fidelity, user scriptable, archival crawler that uses Chrome or Chromium with or without a head

CoCrawler is a versatile web crawler built using modern tools and concurrency.

GUI based offensive penetration testing tool (Open Source)

轻量高效的 Trojan 代理，使用 Rust 实现

Lite version of Crawlab. 轻量版 Crawlab 爬虫管理平台

一些爬虫的代码

基于Scrapy的QQ音乐爬虫(QQ Music Spider)，爬取歌曲信息、歌词、精彩评论等，并且分享了QQ音乐中排名前6400名的内地和港台歌手的49万+的音乐语料

🆔一个基于「公民身份号码」规则获取身份证号码中包含的基础信息组件（PHP）

Cookie 🍪 Consent module for Angular.

Touhou Project random music video generator/player, crawling image and video from websites to generate MV.

A php crawler that finds emails on the internets

A cross platform UI crawler which scans view trees then generate and execute UI test cases.

Xenomorph Crawler, a Concise, Declarative and Observable Distributed Crawler(Node / Go / Java / Rust) For Web, RDB, OS, also can act as a Monitor(with Prometheus) or ETL for Infrastructure 💫 多语言执行器，分布式爬虫

Go process used to crawl websites

A Moodle downloader that downloads course content fast from Moodle (eg. lecture pdfs)

ScrapingOutsourcing专注分享爬虫代码 尽量每周更新一个

中华人民共和国行政区划：省级（省份直辖市自治区）、 地级（城市）、 县级（区县）、 乡级（乡镇街道）、 村级（村委会居委会） ，中国省市区镇村二级三级四级五级联动地址数据。

data resource untuk NLP bahasa indonesia

Sample of using proxies to crawl baidu search results.

🕵️‍♂️ LinkedIn profile scraper returning structured profile data in JSON. Works in 2020.

java framework for prerender

🔥 Shadowsocks 账号爬虫

B站用户爬虫 好耶~是爬虫

Alternative for VK Audio API

scrapy专利爬虫（停止维护）

This repository contains all the code I use in my YouTube tutorials.

Fawkes is a tool to search for targets vulnerable to SQL Injection. Performs the search using Google search engine.

一只优雅的正方教务系统爬虫。

Google play scraper for Python inspired by <facundoolano/google-play-scraper>

BaiduSpider，一个爬取百度搜索结果的爬虫，目前支持百度网页搜索，百度图片搜索，百度知道搜索，百度视频搜索，百度资讯搜索，百度文库搜索，百度经验搜索和百度百科搜索。

以 社会学年鉴模式体例规范地统编自2019年末起新冠肺炎疫情进展的时间线。

💻 Quickly crawl the information (e.g. followers, tags, etc...) of an instagram profile. No login required!

请关注端点星案和张展。// 以社会学年鉴模式体例规范地统编自2019年末起武汉新冠肺炎疫情进展的时间线(2019年12月1日-2020年4月24日)。感谢志愿者的辛劳操作。A sociology timeline (2019.12.1-2020.4.24) on how Wuhan Coronavirus break and spread, edited by anonymous volunteers.

Cross-platform persistent and distributed web crawler 🔗

🕷️ A node crawler for github trending.

一款分布式爬虫平台，帮助你更好的管理和开发爬虫。 内置一套爬虫定义规则（模版），可使用模版快速定义爬虫，也可当作框架手动开发爬虫。(兴趣使然的项目，用的不爽了就更新)

😱Full Automatic Amazon Distributed Spider | 亚马逊分布式四国际站采集选款产品|账号admin,密码adminadmin

An Instagram bot developed using the Selenium Framework

To crawl all csgo skins from website.

最新中国地图json文件，可用d3开发中国地图

Crawl instagram photos, posts and videos for download.

leaflet 加载百度瓦片地图图层 以及高德 、天地图等国内常用地图