Vaultswiss army knife for hackers
Stars: ✭ 346 (+188.33%)
Marmot💐Marmot | Web Crawler/HTTP protocol Download Package 🐭
Stars: ✭ 186 (+55%)
Datmusic ApiAlternative for VK Audio API
Stars: ✭ 160 (+33.33%)
FbcrawlA Facebook crawler
Stars: ✭ 536 (+346.67%)
IcrawlerA multi-thread crawler framework with many builtin image crawlers provided.
Stars: ✭ 629 (+424.17%)
Ecommercecrawlers码云仓库链接:AJay13/ECommerceCrawlers
Github 仓库链接:DropsDevopsOrg/ECommerceCrawlers
项目展示平台链接:http://wechat.doonsec.com
Stars: ✭ 3,073 (+2460.83%)
Docs《数据采集从入门到放弃》源码。内容简介:爬虫介绍、就业情况、爬虫工程师面试题 ;HTTP协议介绍; Requests使用 ;解析器Xpath介绍; MongoDB与MySQL; 多线程爬虫; Scrapy介绍 ;Scrapy-redis介绍; 使用docker部署; 使用nomad管理docker集群; 使用EFK查询docker日志
Stars: ✭ 118 (-1.67%)
ScrappleA framework for creating semi-automatic web content extractors
Stars: ✭ 464 (+286.67%)
FilemastaA search application to explore, discover and share online files
Stars: ✭ 571 (+375.83%)
ScrapoxyScrapoxy hides your scraper behind a cloud. It starts a pool of proxies to send your requests. Now, you can crawl without thinking about blacklisting!
Stars: ✭ 1,322 (+1001.67%)
Scrapy RedisRedis-based components for Scrapy.
Stars: ✭ 4,998 (+4065%)
Ruiji.netcrawler framework, distributed crawler extractor
Stars: ✭ 220 (+83.33%)
CrawlabDistributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台,支持任何语言和框架
Stars: ✭ 8,392 (+6893.33%)
Python3 SpiderPython爬虫实战 - 模拟登陆各大网站 包含但不限于:滑块验证、拼多多、美团、百度、bilibili、大众点评、淘宝,如果喜欢请start ❤️
Stars: ✭ 2,129 (+1674.17%)
Haipproxy💖 High available distributed ip proxy pool, powerd by Scrapy and Redis
Stars: ✭ 4,993 (+4060.83%)
Crawlab LiteLite version of Crawlab. 轻量版 Crawlab 爬虫管理平台
Stars: ✭ 122 (+1.67%)
Crawler爬虫, http代理, 模拟登陆!
Stars: ✭ 106 (-11.67%)
FilesensorDynamic file detection tool based on crawler 基于爬虫的动态敏感文件探测工具
Stars: ✭ 227 (+89.17%)
Goribot[Crawler/Scraper for Golang]🕷A lightweight distributed friendly Golang crawler framework.一个轻量的分布式友好的 Golang 爬虫框架。
Stars: ✭ 190 (+58.33%)
ScrapyrtHTTP API for Scrapy spiders
Stars: ✭ 637 (+430.83%)
DotnetcrawlerDotnetCrawler is a straightforward, lightweight web crawling/scrapying library for Entity Framework Core output based on dotnet core. This library designed like other strong crawler libraries like WebMagic and Scrapy but for enabling extandable your custom requirements. Medium link : https://medium.com/@mehmetozkaya/creating-custom-web-crawler-with-dotnet-core-using-entity-framework-core-ec8d23f0ca7c
Stars: ✭ 100 (-16.67%)
GranularHTML5 Granular Synthesiser
Stars: ✭ 113 (-5.83%)
Sentinel CrawlerXenomorph Crawler, a Concise, Declarative and Observable Distributed Crawler(Node / Go / Java / Rust) For Web, RDB, OS, also can act as a Monitor(with Prometheus) or ETL for Infrastructure 💫 多语言执行器,分布式爬虫
Stars: ✭ 118 (-1.67%)
Beetsmusic library manager and MusicBrainz tagger
Stars: ✭ 10,522 (+8668.33%)
ScralaUnmaintained 🐳 ☕️ 🕷 Scala crawler(spider) framework, inspired by scrapy, created by @gaocegege
Stars: ✭ 113 (-5.83%)
ZenmusicSlack / Sonos / Spotify / Node.js - Control Sonos through #Slack
Stars: ✭ 113 (-5.83%)
Examples Of Web Crawlers一些非常有趣的python爬虫例子,对新手比较友好,主要爬取淘宝、天猫、微信、豆瓣、QQ等网站。(Some interesting examples of python crawlers that are friendly to beginners. )
Stars: ✭ 10,724 (+8836.67%)
Pkulaw spider爬取北大法宝网http://www.pkulaw.cn/Case/
Stars: ✭ 113 (-5.83%)
HuehueA simple yet powerful open source LED controller for Windows and Arduino
Stars: ✭ 113 (-5.83%)
Generative.fmA platform for playing generative music in the browser.
Stars: ✭ 1,534 (+1178.33%)
Web Drum SequencerA drum machine and sequencer built with the Web Audio API, React, and Redux.
Stars: ✭ 117 (-2.5%)
BaiducrawlerSample of using proxies to crawl baidu search results.
Stars: ✭ 116 (-3.33%)
Maplebgm DbDefinitive MapleStory music database
Stars: ✭ 112 (-6.67%)
Cnkispidera spider for cnki patent content, just for study and commucation, no use for business.
Stars: ✭ 117 (-2.5%)
Lcrawl一只优雅的正方教务系统爬虫。
Stars: ✭ 112 (-6.67%)
Lyrics.ovhSource of lyrics.ovh and API to search for lyrics of a song
Stars: ✭ 112 (-6.67%)
EdspA cross-platform DSP library written in C++ 11/14. This library harnesses the power of C++ templates to implement a complete set of DSP algorithms.
Stars: ✭ 116 (-3.33%)
WswpCode for the second edition Web Scraping with Python book by Packt Publications
Stars: ✭ 112 (-6.67%)
GraphqueryGraphQuery is a query language and execution engine tied to any backend service.
Stars: ✭ 112 (-6.67%)
Maria QuiteriaBackend para coleta e disponibilização dos dados 📜
Stars: ✭ 115 (-4.17%)
BaiduspiderBaiduSpider,一个爬取百度搜索结果的爬虫,目前支持百度网页搜索,百度图片搜索,百度知道搜索,百度视频搜索,百度资讯搜索,百度文库搜索,百度经验搜索和百度百科搜索。
Stars: ✭ 105 (-12.5%)
Simple Sdl2 AudioA simple SDL2 audio library without SDL_Mixer for playing music and multiple sounds natively in SDL2
Stars: ✭ 111 (-7.5%)
Tiebamanager(已跑路)百度贴吧吧务管理工具,自动扫描帖子并处理违规帖
Stars: ✭ 119 (-0.83%)