736 Open source projects that are alternatives of or similar to Grab Site

网易云音乐 api(第三方)

Web 端反爬技术方案

Continuous Archiving for Postgres

An AliExpress spider for Node

A dockerized, queued high fidelity web archiver based on Squidwarc

A fluent and functional approach to querying HTML

Extracting and parsing structured data with jQuery Selector, XPath or JsonPath from common web format like HTML, XML and JSON.

Android 本地网络小说爬虫，基于jsoup及xpath

A django admin site for scrapy

Main repository with the code for the libraries and daemons

Collection of scrapy spiders which can scrape posts, images, and so on from public Facebook Pages.

Crawling GitHub Trending Pages every day

No description or website provided.

📜 A CLI toolkit for extracting and working with your digital history

A non API python program to crawl public photos, posts or followers

Save your bookmark collection in the Internet Archive, or locally.

Az összes számlád még egy helyen :)

🎬 基于Pyqt5的简单电影搜索工具

Intelligent proxy pool for Humans™ (Maintainer needed)

FofaMap是一款基于Python3开发的跨平台FOFA数据采集器，支持网站图标查询、批量查询和自定义查询FOFA数据，能够根据查询结果自动去重并生成对应的Excel表格。另外春节特别版还可以调用Nuclei对目标进行漏洞扫描，让你在挖洞路上快人一步。

项目已经移动至：https://github.com/BaiduSpider/BaiduSpider ！！ 一个爬取百度搜索结果的爬虫，目前支持百度网页搜索，百度图片搜索，百度知道搜索，百度视频搜索，百度资讯搜索，百度文库搜索，百度经验搜索和百度百科搜索。

Crawler (Bot) searching for credential leaks on different paste sites.

download document from book118 for free

A spider tapestry weaver

Videodl: A lightweight video downloader written by pure python.

一个简单的基于DHT协议的BT磁力链接爬虫

A search application to explore, discover and share online files

Easy way to brute-force web directory.

🎓 中国大学MOOC、学堂在线、网易云课堂、好大学在线、爱课程 MOOC 课程下载。

Distributed crawler powered by Headless Chrome

QQZone mood spider and analysis. QQ空间多线程爬虫和数据挖掘。提供线上服务，扫码登陆即可自动爬取和分析数据，还有网易云年度报告风格的数据展示；使用docker-compose打包程序，方便部署；额外提供QQ空间抽奖小程序。

CLI and local web plain text note‑taking, bookmarking, and archiving with linking, tagging, filtering, search, Git versioning & syncing, Pandoc conversion, + more, in a single portable script.

A DHT Spider allows you to sniff the torrents and magnets.You can download them directly.

Download videos from pornhub.

Dump and restore Docker Compose-projects

Crawler for Nintendo Switch eShop

Dynamic file detection tool based on crawler 基于爬虫的动态敏感文件探测工具

无cookie版微博爬虫，可以连续爬取一个或多个新浪微博用户信息、用户微博及其微博评论转发。

Tools for tracking stories on news homepages

A Swift Web Crawler 🕷

🐤️ Lost Ark wait notifier

豆瓣电影top250、斗鱼爬取json数据以及爬取美女图片、淘宝、有缘、CrawlSpider爬取红娘网相亲人的部分基本信息以及红娘网分布式爬取和存储redis、爬虫小demo、Selenium、爬取多点、django开发接口、爬取有缘网信息、模拟知乎登录、模拟github登录、模拟图虫网登录、爬取多点商城整站数据、爬取微信公众号历史文章、爬取微信群或者微信好友分享的文章、itchat监听指定微信公众号分享的文章

A web crawler. Supercrawler automatically crawls websites. Define custom handlers to parse content. Obeys robots.txt, rate limits and concurrency limits.

V2EX爬虫

The news homepage archive

逆向app的sign等参数的思路和体验, 安卓逆向, 安卓破解, 逆向app,爬虫解密

搜索你的知乎收藏：可以直观地浏览你的所有收藏夹的内容，并进行全文搜索

Social media (Weibo) comments analyzing toolbox in Chinese 微博评论分析工具, 实现功能: 1.微博评论数据爬取; 2.分词与关键词提取; 3.词云与词频统计; 4.情感分析; 5.主题聚类

Bittorrent dht network spider

一个基于Glang语言开发的站群系统（蜘蛛池系统）

PTT 網路版爬蟲

A Tumblr Backup Application

汤不热 python 多线程爬虫

E-ARK Web is a software for the creation and management of archival information packages, and it supports full-text search for individual files contained in them.

爬虫Demo，基于Python实现

一些爬虫开发的技巧和案例

最简单的91porn爬虫php版本

爬取菜鸟教程网站并转PDF__python_crawer_by_chrome

🕷 A lightning fast multithreaded network scanner framework with modules.

抖音接口、抖音API、抖音数据爬虫、抖音直播数据、抖音直播Api、抖音视频Api、抖音爬虫、抖音去水印、抖音视频下载、抖音视频解析、抖音直播监控、抖音数据采集