733 Open source projects that are alternatives of or similar to photo-spider-scrapy

正方教务管理系统学生版的自动登录、选课、信息获取

Scrapy project boilerplate done right

👍 京东爬虫（大量注释，对刚入门爬虫者极度友好）

带图形界面的哔哩哔哩漫画下载工具

Photo/Video Selector-Supports LivePhoto, GIF selection, online download of resources on iCloud, and editing of photos/videos

新浪爬虫，基于Python+Selenium。模拟登陆后保存cookie，实现登录状态的保存。可以通过输入关键词来爬取到关键词相关的热门微博。

动漫之家漫画站电脑版原图爬虫

百度贴吧生日爬虫，可抓取贴吧内吧友生日，并且在对应日期自动发送祝福

A Web Crawler that scrapes using YAML and python code.

古汉语(文言文)字典-爬取文言文字典网,制作Kindle字典.

A bash script to spider a site, follow links, and fetch urls (with built-in filtering) into a generated text file.

Discord bot for Wikimedia projects and MediaWiki wiki sites

A middleware of cookies persistence for Scrapy

Pageviews Analysis tool for Wikimedia Foundation wikis

爬取拉勾、BOSS直聘、智联招聘、51job、赶集招聘、58招聘等职位信息

PTT 表特版爬蟲圖片下載器

An open etymology dataset created using Wiktionary data. Contains 3.8M entries, 1.8M terms, 2900 languages, and 31 unique relationship types.

UFC bout winner prediction using neural nets.

No description or website provided.

iCloud Photo Downloader - Fetch Originals from iCloud Photo Library

No description or website provided.

利用墨墨背单词的分享功能拿每日20个的单词上限奖励（多线程

客户端爬虫安卓端demo

Spider项目将会不断更新本人学习使用过的爬虫方法！！！

some small project and some articles

自动答题程序🎉

A lightweight, responsive, smart gallery based on jQuery

爬虫管理系统，支持集群，弹性伸缩。支持运行feapder、scrapy、selenium、playwright等各种框架及脚本

Simple and friendly Bot for Instagram, using Selenium and Scrapy with Python.

show full stack technology applications : Scrapy + webservice[restful] + websocket + VueJS + MongoDB

A Scrapy middleware to bypass the CloudFlare's anti-bot protection

微博话题关键词,个人微博采集, 微博博文一键删除 selenium获取cookie,requests处理

🚀「Douyin_TikTok_Download_API」是一个开箱即用的高性能异步抖音|TikTok数据爬取工具，支持API调用，在线批量解析及下载。

📷 Easy Photo Map is a photomap application that displays the location of the photo on the map using the location information included in the photo.

一个php爬虫

A rich text editor for mobile web. Mixed editing of photos and Emoji 一个适用于移动web的富文本编辑器。照片加emoji的混合编辑

Scriptable desktop app to correct the perspective of images

libopenraw: RAW file parsing and processing library (mirror and WiP)

Golang module to detect bots and crawlers via the user agent

A command line tool and module for Google Street View Image API

一些简单有趣的Python小Demo

bing、google、baidu搜索引擎爬虫。python3.6 and scrapy

图片爬取下载工具，极速爬取下载 站酷https://www.zcool.com.cn/, CNU 视觉 http://www.cnu.cc/ 设计师/用户 上传的 图片/照片/插画。

Generate an object for testing if a request is sent, request is Mikeal's request.

计算机基础知识，数据结构，设计模式，Tomcat中间件的实现

DSLR Browser iOS app to discover and connect to your Wi-Fi and DLNA enabled (Canon) camera

😚 Q & A website based on Spring Boot.

python 爬虫(amazon, confluence ...)

Grabs all of the audio files from all of the Blinkist books

这可能是爬百度文库最全的项目了

ICP备案查询，可查询企业或域名的ICP备案信息，自动完成滑动验证，保存结果到Excel表格，适用于2022年新版的工信部备案管理系统网站，告别频繁拖动验证，以及某站*工具要开通VIP才可查看备案信息的坑

bet365 bot: bet365的比赛实时比分数据、实时赔率

Scrapy, a fast high-level web crawling & scraping framework for dart and Flutter

📻 An OLX Scraper using Scrapy + MongoDB. It Scrapes recent ads posted regarding requested product and dumps to NOSQL MONGODB.

这是一个用Python写的小说爬虫软件

Spin up Tor containers and then proxy HTTP requests via these Tor instances

爬虫学习仓库，适合零基础的人学习，对新手比较友好

A Scrapy extension to log items coverage when the spider shuts down

简单、免费、高效的百度地图poi采集和分析工具。

Powerful Unsplash package for Laravel