495 Open source projects that are alternatives of or similar to Weibopicdownloader

🖼 新浪微博图床 Chrome/Firefox 扩展，支持同步到微相册

一只优雅的正方教务系统爬虫。

一个超级轻量的百度图片爬虫

以Node.js基于express以及爬虫实现的视频资源后端

Simple but useful Python web scraping tutorial code.

BaiduSpider，一个爬取百度搜索结果的爬虫，目前支持百度网页搜索，百度图片搜索，百度知道搜索，百度视频搜索，百度资讯搜索，百度文库搜索，百度经验搜索和百度百科搜索。

NetDiscovery 是一款基于 Vert.x、RxJava 2 等框架实现的通用爬虫框架/中间件。

Bitextor generates translation memories from multilingual websites.

Fess is very powerful and easily deployable Enterprise Search Server.

💻 Quickly crawl the information (e.g. followers, tags, etc...) of an instagram profile. No login required!

A distributed web crawler framework.（分布式爬虫框架XXL-CRAWLER）

Download weibo images without logging-in

Distributed crawler powered by Headless Chrome

Cross-platform persistent and distributed web crawler 🔗

Redis-based components for Scrapy.

Polite, slim and concurrent web crawler.

支援 PTT 還有 PTT2 的 PTT API

Fawkes is a tool to search for targets vulnerable to SQL Injection. Performs the search using Google search engine.

💖 High available distributed ip proxy pool, powerd by Scrapy and Redis

Antch, a fast, powerful and extensible web crawling & scraping framework for Go

a new crawler based on python with more function including Network fingerprint search

Scrapy, a fast high-level web crawling & scraping framework for Python.

一个 Vue 微博客户端

JS逆向研究

🐨实时监控1000家中国企业的新闻动态

A web crawler (for bug hunting) that gathers more than you can imagine.

A framework for creating semi-automatic web content extractors

Creates an XML-Sitemap by crawling a given site.

LinkedIn Scraper (currently working 2020)

爬虫, http代理, 模拟登陆!

Crawl BookCorpus

DownZemAll! is a download manager for Windows, MacOS and Linux

OWASP D4N155 - Intelligent and dynamic wordlist using OSINT

爬取菜鸟教程网站并转PDF__python_crawer_by_chrome

稳健高效的评分制-针对性- IP代理池 + API服务，可以自己插入采集器进行代理IP的爬取，针对你的爬虫的一个或多个目标网站分别生成有效的IP代理数据库，支持MongoDB 4.0 使用 Python3.7（Scored IP proxy pool ,customise proxy data crawler can be added anytime）

Script that crawls meta data from ICLR OpenReview webpage. Tutorials on installing and using Selenium and ChromeDriver on Ubuntu.

微博批量关注 (转移关注列表)

Open-source Enterprise Grade Search Engine Software

scrapes medias, likes, followers, tags and all metadata. Inspired by instagram-php-scraper,bot

OSINT Swiss Army Knife

Async Python 3.6+ web scraping micro-framework based on asyncio

提供微博、微信、QQ、Tim、QQ 轻聊版、钉钉的登陆分享功能支持;

Dynamic file detection tool based on crawler 基于爬虫的动态敏感文件探测工具

各种App、小程序、网站的请求签名或加密算法。 现已有：自如、小红书、蛋壳公寓、luckin coffee(瑞幸咖啡)、bangkokair(曼谷航空)

🎵 将可下载的网易云音乐的缓存文件转换为 MP3 文件

File system crawler, disk space usage, file search engine and file system analytics powered by Elasticsearch

新浪微博爬虫，用python爬取新浪微博数据

GOPA, a spider written in Go.（NOTE: this project moved to https://github.com/infinitbyte/gopa ）

a reliable high-level web crawling & scraping framework for Node.js.

Get (almost) original messages from google group archives. Your data is yours.

As you can see, a kuaishou crawler

Web Crawler written in C#

Amazon商品引流的 python 爬虫

直接通过链家 API 抓取数据的极速爬虫，宇宙最快~~ 🚀

MonkeyKing helps you to post messages to Chinese Social Networks.

A Kotlin-based testing/scraping/parsing library providing the ability to analyze and extract data from HTML (server & client-side rendered). It places particular emphasis on ease of use and a high level of readability by providing an intuitive DSL. It aims to be a testing lib, but can also be used to scrape websites in a convenient fashion.

Crawl all unique internal links found on a given website, and extract SEO related information - supports javascript based sites

Simple news aggregator displaying top stories in real time

네이버 뉴스 수집을 위한 도구