1142 Open source projects that are alternatives of or similar to Goribot

🎬 电影资源爬虫,电影图片抓取脚本,Flask|Nginx|wsgi

📙 中华新华字典数据库。包括歇后语，成语，词语，汉字。

vulnx 🕷️ is an intelligent bot auto shell injector that detect vulnerabilities in multiple types of cms { `wordpress , joomla , drupal , prestashop .. `}

🐦 Access Twitter data without an API key. [DEPRECATED]

Google Search SERP Scraper

滑动验证码，希望对你们有所帮助❤️

慕课网python分布式爬虫源码-长期更新维护

Discover hidden deepweb pages

微博爬虫：每天定时爬取微博热搜榜的内容，留下互联网人的记忆。

微信公众号文章的爬虫

由Python编写的全异步实现的动漫之家(dmzj)漫画批量下载器（爬虫）

抖音API、抖音数据、抖音直播数据、抖音直播Api、抖音视频Api、抖音爬虫、抖音去水印、抖音视频下载、抖音视频解析、抖音直播监控、抖音数据采集

🔍 简单的搜索引擎, django 框架

A python3 crawler for crawling Pixiv ranking top and any illustrator all artworks

This is a sina weibo spider built by scrapy [微博爬虫/持续维护]

用 node.js 爬你自己的 leetcode 解题源码

⛏ a library for scraping things

data resource untuk NLP bahasa indonesia

NetCloud Web Spider

Find web directories without bruteforce

A GUI client of schannel powered by therecipe/qt and golang

最新动态在这里【我的程序员日志】

The fast website crawler

Simple Web UI for Scrapy spider management via Scrapyd

Everybody can be scrapy guru

一只优雅的正方教务系统爬虫。

那些年，我爬过的北科。一个由浅入深的定向爬虫教程。

File system crawler, disk space usage, file search engine and file system analytics powered by Elasticsearch

Code for the second edition Web Scraping with Python book by Packt Publications

Web Crawler written in C#

Messenger Bot that scrapes for COVID-19 data and periodically updates subscribers via Facebook Messages. Created using Python/Flask, MYSQL, HTML, Heroku

👨‍🎓 中国大学MOOC全课件（视频、文档、附件）下载器

🔥 Shadowsocks 账号爬虫

又一个 java 内容（pa）获取（chong）工具

news-please - an integrated web crawler and information extractor for news that just works.

A Go package for working with headless Chrome. Run interactive JavaScript commands on web pages with Go and Chrome.

抖音爬虫. 通过手机代理爬取用户的作品和用户的喜欢

Crawler for leboncoin.fr

一个浏览器端数据爬虫，做每个人的数据助手

Scrape job websites into a single spreadsheet with no duplicates.

🐞简单轻便的Java爬虫框架，只要会一点简单的正则表达式和简单的css选择器就能轻松的采集数据。

Web scraper that makes it easier to find real estate in Slovenia.

GraphQuery is a query language and execution engine tied to any backend service.

Search for and retrieve US Patent and Trademark Office Patent Data

破解JS反爬虫加密参数，已破解中国裁判文书网（2020-06-30更新），淘宝密码，天安保险登录，b站登录，房天下登录，WPS登录，微博登录，有道翻译，网易登录，微信公众号登录，空中网登录，今目标登录，学生信息管理系统登录，共赢金融登录，重庆科技资源共享平台登录，网易云音乐下载，一键解析视频链接，财联社登录。

All Terrain Autonomous Quadruped

Google, Naver multiprocess image web crawler (Selenium)

用严肃的数据来回答“什么样的企业会到什么样的大学招聘”？

头条号爬虫案例

A configurable web spider with a easy-to-use web console

Analysis of the characteristics of different countries

Google2Csv a simple google scraper that saves the results on a csv/xlsx/jsonl file

🕷招聘网站爬虫合集，不定期更新分支

Anitop is an unofficial simple API from https://anitrendz.net/ site

A Node.js wrapper for scraping allrecipes.com

Create agents that monitor and act on your behalf. Your agents are standing by!

Polite, slim and concurrent web crawler.

scrapy框架爬取51job(scrapy.Spider)，智联招聘(扒接口)，拉勾网(CrawlSpider)

💻 Quickly crawl the information (e.g. followers, tags, etc...) of an instagram profile. No login required!

Download website to local directory (including all css, images, js, etc.)