846 Open source projects that are alternatives of or similar to Weibo Album Crawler

Exchange Rest And WebSocket API For Golang Wrapper support okcoin,okex,huobi,hbdm,bitmex,coinex,poloniex,bitfinex,bitstamp,binance,kraken,bithumb,zb,hitbtc,fcoin, coinbene

AV 电影管理系统， avmoo , javbus , javlibrary 爬虫，线上 AV 影片图书馆，AV 磁力链接数据库，Japanese Adult Video Library,Adult Video Magnet Links - Japanese Adult Video Database

Parser and database to index the terpene profile of different strains of Cannabis from online databases

vulnx 🕷️ is an intelligent bot auto shell injector that detect vulnerabilities in multiple types of cms { `wordpress , joomla , drupal , prestashop .. `}

It makes a preview from an URL, grabbing all the information such as title, relevant texts and images.

Easy Swift Futures & Promises.

hproxy - Asynchronous IP proxy pool, aims to make getting proxy as convenient as possible.(异步爬虫代理池)

Discover hidden deepweb pages

An Objective-C future implementation that aims to provide maximal type safety

Rust Web Crawler saving pages on Redis

A document viewer; fuzzy match incremental search.

🔍 简单的搜索引擎, django 框架

An online tool (crawler) to analyze users performance in online judges (coding competition websites). Supported OJ: POJ, HDU, ZOJ, HYSBZ, CodeForces, UVA, ICPC Live Archive, FZU, SPOJ, Timus (URAL), LeetCode_CN, CSU, LibreOJ, 洛谷, 牛客OJ, Lutece (UESTC), AtCoder, AIZU, CodeChef, El Judge, BNUOJ, Codewars, UOJ, NBUT, 51Nod, DMOJ, VJudge

Deprecated issue-tracking repo, please post new issues or feature requests to istio/istio instead.

A utility package for automating lighthouse reporting

OpenSourceTest由自动化测试-夜行者社区维护，提供的是更多地灵活性和可配置性

Golang pkg to quickly return a preview of a webpage (title/description/images)

A GUI client of schannel powered by therecipe/qt and golang

🌇 🌆 🌉 Advanced, user-friendly, language-agnostic, super-high-performance test runner. http://sumanjs.org

那些年，我爬过的北科。一个由浅入深的定向爬虫教程。

POOPAK - TOR Hidden Service Crawler

Web Crawler written in C#

A powerful dynamic crawler for web vulnerability scanners

news-please - an integrated web crawler and information extractor for news that just works.

Python爬虫，京东自动登录，在线抢购商品

抖音爬虫. 通过手机代理爬取用户的作品和用户的喜欢

Golang爬虫 爬取汽车之家 二手车产品库

🐞简单轻便的Java爬虫框架，只要会一点简单的正则表达式和简单的css选择器就能轻松的采集数据。

tumblr解析网站

用严肃的数据来回答“什么样的企业会到什么样的大学招聘”？

哔咔漫画收藏夹下载程序

头条号爬虫案例

Some scrapy and web.py exmaples

A library that allows to listen network sockets with proper resource limits and error handling

仿微信，微博的大图查看和视频播放 拖拽消失的手势动画。手势单独已抽离出来，可用于任何视图。Simulate Wechat's disappeared gesture animation by dragging when the big picture viewing or video playback . Gestures are separated and can be used in any view

Python: An all-in-one Web Crawler, Web Parser and Web Scrapping library!

Crawler used to crawl papers

python crawler spider

Koa middleware and api sdk for wechat oauth, qq oauth, baidu oauth and weibo oauth

Scrapy as a Web Crawler for Azure Search Samples

Tor website crawler (specific for Alphabay at the time)

Leetcode Contest Ranking Searcher

Fetches PubMed article IDs (PMIDs) from email inbox, then crawls PubMed, Google Scholar and Sci-Hub for respective PDF files.

Zero-cost futures support for rust-mdo

Powerful web scraping framework for Crystal

This package is a complete tool for creating a large dataset of images (specially designed -but not only- for machine learning enthusiasts). It can crawl the web, download images, rename / resize / covert the images and merge folders..

💥 Middlewares / Relay / PSR-7 support to Nette Framework (@nette)

Implementation-agnostic asynchronous code

A concurrent circuit breaker implemented with ring buffers

🌎 xhr.js is a library(< 2Kb) to make AJAX/HTTP requests with XMLHttpRequest.

Crawl websites for accessibility issues from the command line.

Download comics novels 小说漫画下载工具 小説漫画のダウンローダ 小說漫畫下載:腾讯漫画 大角虫漫画 有妖气 知音漫客 咪咕 SF漫画 哦漫画 看漫画 漫画柜 汗汗酷漫 動漫伊甸園 快看漫画 微博动漫 733动漫网 大古漫画网 漫画DB 無限動漫 動漫狂 卡推漫画 动漫之家 动漫屋 古风漫画网 36漫画网 亲亲漫画网 乙女漫画 comico webtoons 咚漫 ニコニコ静画 ComicWalker ヤングエースUP モアイ pixivコミック サイコミ;アルファポリス カクヨム ハーメルン 小説家になろう 起点中文网 八一中文网 顶点小说 落霞小说网 努努书坊 笔趣阁→epub.

A new Unix shell.

A crawler for automated functional testing of a web application

🏀 Python3 网络爬虫实战（部分含详细教程）猫眼 腾讯视频 豆瓣 研招网 微博 笔趣阁小说 百度热点 B站 CSDN 网易云阅读 阿里文学 百度股票 今日头条 微信公众号 网易云音乐 拉勾 有道 unsplash 实习僧 汽车之家 英雄联盟盒子 大众点评 链家 LPL赛程 台风 梦幻西游、阴阳师藏宝阁 天气 牛客网 百度文库 睡前故事 知乎 Wish

Sina stock options crawler with CSV output 新浪上证ETF期权数据爬虫

必看！java后端，亮剑诛仙。java发展路线技术要点。

Get the lyrics for the song currently playing on Spotify

⚔️ Saber, PHP异步协程HTTP客户端 | PHP Coroutine HTTP client - Swoole Humanization Library

Simple CORPORA list crawler