398 Open source projects that are alternatives of or similar to Scan T

基于 Selenium 的知乎关键词爬虫

哔咔漫画收藏夹下载程序

A Smart, Automatic, Fast and Lightweight Web Scraper for Python

This package is a complete tool for creating a large dataset of images (specially designed -but not only- for machine learning enthusiasts). It can crawl the web, download images, rename / resize / covert the images and merge folders..

链家网和贝壳网房价爬虫，采集北京上海广州深圳等21个中国主要城市的房价数据（小区，二手房，出租房，新房），稳定可靠快速！支持csv,MySQL, MongoDB,Excel, json存储，支持Python2和3，图表展示数据，注释丰富 ，点星支持，仅供学习参考，请勿用于商业用途，后果自负。

基于NodeJS的基金数据爬虫，爬取的数据存于github的@nullpointer/fund-data。

🐛一只登录正方教务管理系统，爬取数据的小爬虫

A Strong, Fast and Flexible Pixiv Client based on .NET Core and WPF

Collection of China illegal cases about web crawler 本项目用来整理所有中国大陆爬虫开发者涉诉与违规相关的新闻、资料与法律法规。致力于帮助在中国大陆工作的爬虫行业从业者了解我国相关法律，避免触碰数据合规红线。 [AD]中文知识图谱门户

Incredibly fast crawler designed for OSINT.

A framework for creating semi-automatic web content extractors

Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台，支持任何语言和框架

Crawl instagram photos, posts and videos for download.

💐 Full Amazon Automatic Download

No description or website provided.

Rust Web Crawler saving pages on Redis

用 node.js 爬你自己的 leetcode 解题源码

A python3 crawler for crawling Pixiv ranking top and any illustrator all artworks

台灣上市上櫃股票爬蟲 Taiwan Stock Exchange Crawler

A GUI client of schannel powered by therecipe/qt and golang

那些年，我爬过的北科。一个由浅入深的定向爬虫教程。

Az összes számlád még egy helyen :)

Web Crawler written in C#

🕵️‍♂️ LinkedIn profile scraper returning structured profile data in JSON. Works in 2020.

[DEPRECATED] Simple, flexible, delightful web crawler/spider package

🍻 bilibili video (including bangumi) and danmaku downloader | B站视频（含番剧）、弹幕下载器

Crawler for leboncoin.fr

🕷️ A node crawler for github trending.

Google, Naver multiprocess image web crawler (Selenium)

🍰 一个可视化的爬虫平台

头条号爬虫案例

Web crawling framework based on asyncio.

Scrapy as a Web Crawler for Azure Search Samples

Android 本地网络小说爬虫，基于jsoup及xpath

Fetches PubMed article IDs (PMIDs) from email inbox, then crawls PubMed, Google Scholar and Sci-Hub for respective PDF files.

Script that generates a sitemap by crawling a given URL

Sina stock options crawler with CSV output 新浪上证ETF期权数据爬虫

Easy way to brute-force web directory.

Distributed Image Search Engine Crawler

Bitextor generates translation memories from multilingual websites.

获取最新可备案域名列表爬虫

Html网页正文提取

[ Closed ] 🎨 image collector, which supports custom acquisition source configuration and is compatible with MacOS and Windows operating systems.

Polite, slim and concurrent web crawler.

Android应用市场网络爬虫

Crawling CV conference papers with Python.

基于appium的app自动遍历工具

JS逆向研究

👧 美女写真套图爬虫（二）

A web crawler. Supercrawler automatically crawls websites. Define custom handlers to parse content. Obeys robots.txt, rate limits and concurrency limits.

DownZemAll! is a download manager for Windows, MacOS and Linux

A collection of awesome web crawler,spider in different languages

Declarative web scraping

Python的基础练习代码与各种爬虫代码

What do people have in their dotfiles?

Crawler (Bot) searching for credential leaks on different paste sites.

Update Version of weibo_terminator, This is Workflow Version aim at Get Job Done!

Creates an XML-Sitemap by crawling a given site.

A web crawler (for bug hunting) that gathers more than you can imagine.