495 Open source projects that are alternatives of or similar to Weibopicdownloader

🔍 简单的搜索引擎, django 框架

Elegant Scraper and Crawler Framework for Golang

Find web directories without bruteforce

适用于 Stylus 等插件的微博美化样式

A GUI client of schannel powered by therecipe/qt and golang

Crawl instagram photos, posts and videos for download.

The fast website crawler

那些年，我爬过的北科。一个由浅入深的定向爬虫教程。

抖音爬虫. 通过手机代理爬取用户的作品和用户的喜欢

Squidwarc is a high fidelity, user scriptable, archival crawler that uses Chrome or Chromium with or without a head

🐞简单轻便的Java爬虫框架，只要会一点简单的正则表达式和简单的css选择器就能轻松的采集数据。

用 node.js 爬你自己的 leetcode 解题源码

用严肃的数据来回答“什么样的企业会到什么样的大学招聘”？

GUI based offensive penetration testing tool (Open Source)

头条号爬虫案例

Final Weibo Crawler Scrap Anything From Weibo, comments, weibo contents, followers, anything. The Terminator

Scrapy as a Web Crawler for Azure Search Samples

Download Videos Skill Share per ID or per Class

Fetches PubMed article IDs (PMIDs) from email inbox, then crawls PubMed, Google Scholar and Sci-Hub for respective PDF files.

疫情数据爬虫，2019新型冠状病毒数据仓库，轨迹数据，同乘数据，报道

Sina stock options crawler with CSV output 新浪上证ETF期权数据爬虫

简单易用的Python爬虫框架，QQ交流群：597510560

Distributed Image Search Engine Crawler

Proxy [Finder | Checker | Server]. HTTP(S) & SOCKS 🎭

获取最新可备案域名列表爬虫

（已跑路）百度贴吧吧务管理工具，自动扫描帖子并处理违规帖

[ Closed ] 🎨 image collector, which supports custom acquisition source configuration and is compatible with MacOS and Windows operating systems.

🥄 A package for building specific Proxy Pool for different Sites.

📣 Social sharing plugin for VuePress

获取免费socks/https/http代理的网站集合

Scraping scripts for various websites.

A Cordova wrapper around the Sina WeiboSDK for Android and iOS. Provides access to ssoLogin, WeiboSharing etc...

A Tumblr Blog Backup Application

Xenomorph Crawler, a Concise, Declarative and Observable Distributed Crawler(Node / Go / Java / Rust) For Web, RDB, OS, also can act as a Monitor(with Prometheus) or ETL for Infrastructure 💫 多语言执行器，分布式爬虫

Elasticsearch File System Crawler (FS Crawler)

Crawler for LinkedIn full profiles 2019

The Last Web Recon Tool You'll Need

A Moodle downloader that downloads course content fast from Moodle (eg. lecture pdfs)

使用python抓取微博数据并对微博文本分析和可视化，LDA（树图）、关系图、词云、时间趋势（折线图）、热度地图、词典情感分析（饼图和3D柱状图）、词向量神经网络情感分析、tfidf聚类、词向量聚类、关键词提取、文本相似度分析等

Python脚本。模拟登录知乎， 爬虫，操作excel，微信公众号，远程开机

一些非常有趣的python爬虫例子,对新手比较友好,主要爬取淘宝、天猫、微信、豆瓣、QQ等网站。(Some interesting examples of python crawlers that are friendly to beginners. )

Life is short, *****.

Python爬虫代理IP池(proxy pool)

一款简约而不失强大的 ActionSheet，微博、微信和 QQ 都采用了极其类似的样式，完全支持 Swift。

java framework for prerender

Gospider - Fast web spider written in Go

🕷️ The progressive PHP crawler framework! 优雅的渐进式PHP采集框架。

A tool for pixiv.net. 人人可用的P站爬虫

B站用户爬虫 好耶~是爬虫

A simple and flexible web crawler that follows the robots.txt policies and crawl delays.

Crawl some picture for fun

File system crawler, disk space usage, file search engine and file system analytics powered by Elasticsearch

As you can see, a kuaishou crawler

Web Crawler written in C#

scrapy专利爬虫（停止维护）

直接通过链家 API 抓取数据的极速爬虫，宇宙最快~~ 🚀

MonkeyKing helps you to post messages to Chinese Social Networks.

A Kotlin-based testing/scraping/parsing library providing the ability to analyze and extract data from HTML (server & client-side rendered). It places particular emphasis on ease of use and a high level of readability by providing an intuitive DSL. It aims to be a testing lib, but can also be used to scrape websites in a convenient fashion.

Crawl all unique internal links found on a given website, and extract SEO related information - supports javascript based sites

Simple news aggregator displaying top stories in real time