733 Open source projects that are alternatives of or similar to photo-spider-scrapy

A Scrapy extension to log items coverage when the spider shuts down

gathertool是golang脚本化开发库，目的是提高对应场景程序开发的效率；轻量级爬虫库，接口测试&压力测试库，DB操作库等。

正方教务管理系统学生版的自动登录、选课、信息获取

Instagram Photo Downloader

Scrapy project boilerplate done right

My code for scraping financial data in Vietnam

带图形界面的哔哩哔哩漫画下载工具

基于Electron爬虫程序

Photo/Video Selector-Supports LivePhoto, GIF selection, online download of resources on iCloud, and editing of photos/videos

Crawling the data from lazada, websosanh, compare.vn, cdiscount and cungmua with flexible configs

百度贴吧生日爬虫，可抓取贴吧内吧友生日，并且在对应日期自动发送祝福

python爬虫项目集合

A Web Crawler that scrapes using YAML and python code.

Grapy, a fast high-level web crawling framework for Python 3.3 or later base on asyncio.

A bash script to spider a site, follow links, and fetch urls (with built-in filtering) into a generated text file.

A Node JS Express/Serverless demo application that creates a personalised video using a form. Uses the Pexels Video library and Shotstack video editing API.

Discord bot for Wikimedia projects and MediaWiki wiki sites

⚡ Light weight Golang spider framework | 轻量的 Golang 爬虫框架

PTT 表特版爬蟲圖片下載器

An open etymology dataset created using Wiktionary data. Contains 3.8M entries, 1.8M terms, 2900 languages, and 31 unique relationship types.

No description or website provided.

简单、免费、高效的百度地图poi采集和分析工具。

Tool for uploading files to Wikimedia Commons and other Wikimedia projects

iCloud Photo Downloader - Fetch Originals from iCloud Photo Library

A scrapy middleware to use rotated proxy ip list.

客户端爬虫安卓端demo

📷 A composable image editor using Core Image and Metal.

Spider项目将会不断更新本人学习使用过的爬虫方法！！！

Using scrapy to scrape tripadvisor in order to get users' reviews.

爬虫管理系统，支持集群，弹性伸缩。支持运行feapder、scrapy、selenium、playwright等各种框架及脚本

自动答题程序🎉

Powerful Unsplash package for Laravel

Raspagem de dados para iniciante usando Scrapy e outras libs básicas

简洁好用的多用户图片社区。

A Scrapy middleware to bypass the CloudFlare's anti-bot protection

python+scrapy+splash 爬取拉勾全站职位信息

微博话题关键词,个人微博采集, 微博博文一键删除 selenium获取cookie,requests处理

Pagser is a simple, extensible, configurable parse and deserialize html page to struct based on goquery and struct tags for golang crawler

World’s single largest Internet domains dataset

📷 Easy Photo Map is a photomap application that displays the location of the photo on the map using the location information included in the photo.

超高速异步协程Python爬虫

Scriptable desktop app to correct the perspective of images

A spider tapestry weaver

libopenraw: RAW file parsing and processing library (mirror and WiP)

Scraping the real estate agencies for up-to-date house listings as soon as they arrive!

bing、google、baidu搜索引擎爬虫。python3.6 and scrapy

A command line tool and module for Google Street View Image API

虎扑步行街爬虫

爬虫集合

Generate an object for testing if a request is sent, request is Mikeal's request.

直接通过链家 API 抓取数据的极速爬虫，宇宙最快~~ 🚀

计算机基础知识，数据结构，设计模式，Tomcat中间件的实现

妹子图全站采集10G套图资源

Using Scrapy to crawl Autohome, storage into MonogDB, simple analysis and NLP coming soon

Python program that makes a photo mosaic out of a given image

Distributed crawling/scraping, Kafka And Redis based components for Scrapy

相册照片多张选择控件

With Selenium headless browsing and CAPTCHA solving

A web crawler for Go

A web spider framework