846 Open source projects that are alternatives of or similar to Weibo Album Crawler

APIs for loginning some websites by using requests.

根据关键词抓取微博数据，再生成词云

🎓 中国大学MOOC、学堂在线、网易云课堂、好大学在线、爱课程 MOOC 课程下载。

一个灵活、友好的爬虫框架

Simple but useful Python web scraping tutorial code.

Tổng hợp script crawl dữ liệu từ các mạng xã hội & website tiếng Việt

爬取 www.mzitu.com 全站图片，截至目前共5162个图集，16.5万多张美女图片，使用 asyncio 和 aiohttp 实现的异步版本只需要不到2小时就能爬取完成。按日期创建图集目录，保存更合理。控制台只显示下载的进度条，详细信息保存在日志文件中。支持异常处理，不会终止爬虫程序。失败的请求，下次再执行爬虫程序时会自动下载

微博话题关键词,个人微博采集, 微博博文一键删除 selenium获取cookie,requests处理

Python3爬虫系列的理论验证，首先研究I/O模型，分别用Python实现了blocking I/O、nonblocking I/O、I/O multiplexing各模型下的TCP服务端和客户端。然后，研究同步I/O操作（依序下载、多进程并发、多线程并发）和异步I/O（asyncio）之间的效率差别

微博超级话题爬虫，微博词频统计+情感分析+简单分类，新增肺炎超话爬取数据

无cookie版微博爬虫，可以连续爬取一个或多个新浪微博用户信息、用户微博及其微博评论转发。

Social media (Weibo) comments analyzing toolbox in Chinese 微博评论分析工具, 实现功能: 1.微博评论数据爬取; 2.分词与关键词提取; 3.词云与词频统计; 4.情感分析; 5.主题聚类

一个获取知乎用户主页信息的多线程Python爬虫程序。

🍻 bilibili video (including bangumi) and danmaku downloader | B站视频（含番剧）、弹幕下载器

免登录下载微博图片 爬虫 Download Weibo Images without Logging-in

Multithreading download all HD photos / pictures from someone's Sina Weibo album.

京东商品价格监控：监控用户设定商品价格，降价邮件/微信提醒。技术：Python爬虫/IP代理池/JS接口爬取/Selenium页面爬取

ScrapingOutsourcing专注分享爬虫代码 尽量每周更新一个

《数据采集从入门到放弃》源码。内容简介：爬虫介绍、就业情况、爬虫工程师面试题 ；HTTP协议介绍； Requests使用 ；解析器Xpath介绍； MongoDB与MySQL； 多线程爬虫； Scrapy介绍 ；Scrapy-redis介绍； 使用docker部署； 使用nomad管理docker集群； 使用EFK查询docker日志

B站用户爬虫 好耶~是爬虫

Simple Weibo Scraper

新浪微博爬虫，用python爬取新浪微博数据，并下载微博图片和微博视频

爬虫案例合集。包括但不限于《淘宝、京东、天猫、豆瓣、抖音、快手、微博、微信、阿里、头条、pdd、优酷、爱奇艺、携程、12306、58、搜狐、百度指数、维普万方、Zlibraty、Oalib、小说、招标网、采购网、小红书》

Blazing fast concurrent HashMap for Rust.

Some classic web crawler projects.一些经典的爬虫

Easily download all the photos/videos from tumblr blogs. 下载指定的 Tumblr 博客中的图片，视频

EasyLanguage indicators and systems for TradeStation

Exchange Rest And WebSocket API For Golang Wrapper support okcoin,okex,huobi,hbdm,bitmex,coinex,poloniex,bitfinex,bitstamp,binance,kraken,bithumb,zb,hitbtc,fcoin, coinbene

Parser and database to index the terpene profile of different strains of Cannabis from online databases

It makes a preview from an URL, grabbing all the information such as title, relevant texts and images.

An Objective-C future implementation that aims to provide maximal type safety

hproxy - Asynchronous IP proxy pool, aims to make getting proxy as convenient as possible.(异步爬虫代理池)

When you solve the problem of Baekjoon Online Judge, it automatically commits and pushes to the remote repository.

A document viewer; fuzzy match incremental search.

An online tool (crawler) to analyze users performance in online judges (coding competition websites). Supported OJ: POJ, HDU, ZOJ, HYSBZ, CodeForces, UVA, ICPC Live Archive, FZU, SPOJ, Timus (URAL), LeetCode_CN, CSU, LibreOJ, 洛谷, 牛客OJ, Lutece (UESTC), AtCoder, AIZU, CodeChef, El Judge, BNUOJ, Codewars, UOJ, NBUT, 51Nod, DMOJ, VJudge

a puppeteer walker 🕷 🕸

Project thu thập điểm chuẩn đại học 2014 - 2018 và phân tích dữ liệu

Beanbun 是用 PHP 编写的多进程网络爬虫框架，具有良好的开放性、高可扩展性，基于 Workerman。

A utility package for automating lighthouse reporting

Golang pkg to quickly return a preview of a webpage (title/description/images)

A unofficial python module for interacting with the Remarkable Cloud

🌇 🌆 🌉 Advanced, user-friendly, language-agnostic, super-high-performance test runner. http://sumanjs.org

POOPAK - TOR Hidden Service Crawler

高仿微博个人主页 Weibo user profile page based on PersonalHomePageDemo

接口自动化测试平台，已停止维护，看心情改改

A powerful dynamic crawler for web vulnerability scanners

Python爬虫，京东自动登录，在线抢购商品

👔 An implementation of on-the-fly defined WebWorkers that are created inline using data URIs, rather than separate physical files — for the benefit of all humanity.

Golang爬虫 爬取汽车之家 二手车产品库

tumblr解析网站

Verify that a request is from Google crawlers using Google's DNS verification steps

A simple example server in asynchronous Rust for MMO games

A CLI app for downloading file concurrently.

自学入门 Python 优质中文资源索引，包含 书籍 / 文档 / 视频，适用于 爬虫 / Web / 数据分析 / 机器学习 方向

哔咔漫画收藏夹下载程序

Some scrapy and web.py exmaples

PyMoves

仿微信，微博的大图查看和视频播放 拖拽消失的手势动画。手势单独已抽离出来，可用于任何视图。Simulate Wechat's disappeared gesture animation by dragging when the big picture viewing or video playback . Gestures are separated and can be used in any view

Python: An all-in-one Web Crawler, Web Parser and Web Scrapping library!

python crawler spider