GrabberA wrapper for Youtube-dl for Windows.
Stars: ✭ 22 (+37.5%)
udemy-downloaderA Udemy downloader that can download lectures, with DRM support.
Stars: ✭ 507 (+3068.75%)
pythonSpider🕷️some python spiders with BeautifulSoup or scarpy
Stars: ✭ 28 (+75%)
InstaBotSimple and friendly Bot for Instagram, using Selenium and Scrapy with Python.
Stars: ✭ 32 (+100%)
ImageDownloaderA program for downloading and filtering images based on their resolution.
Stars: ✭ 60 (+275%)
spider裁判文书网爬虫
Stars: ✭ 19 (+18.75%)
ptt-studyabroad-api🔎 Search articles with personalized results on ptt/studyabroad
Stars: ✭ 57 (+256.25%)
crawler一个php爬虫
Stars: ✭ 13 (-18.75%)
rb-spider基于 RabbitMQ 中间件的爬虫的 Ruby 实现 [Developing]
Stars: ✭ 13 (-18.75%)
crawlerdetectGolang module to detect bots and crawlers via the user agent
Stars: ✭ 22 (+37.5%)
Spider资讯爬虫App
Stars: ✭ 24 (+50%)
Shadow计算机基础知识,数据结构,设计模式,Tomcat中间件的实现
Stars: ✭ 19 (+18.75%)
talospidertalospider - A simple,lightweight scraping micro-framework
Stars: ✭ 57 (+256.25%)
ICP-CheckerICP备案查询,可查询企业或域名的ICP备案信息,自动完成滑动验证,保存结果到Excel表格,适用于2022年新版的工信部备案管理系统网站,告别频繁拖动验证,以及某站*工具要开通VIP才可查看备案信息的坑
Stars: ✭ 119 (+643.75%)
genome updaterBash script to download/update snapshots of files from NCBI genomes repository (refseq/genbank) with track of changes and without redundancy
Stars: ✭ 93 (+481.25%)
yt2mp3⬇️ Search, Download, and Convert YouTube videos to MP3
Stars: ✭ 89 (+456.25%)
imdb-spiderscrapy spider for scraping imdb {movie_id: [recommended, ...]}
Stars: ✭ 23 (+43.75%)
httputilsHttp工具包:OkHttp轻量封装 、功能全面、设计力求优雅与纯粹,Java领域前后端处Http问题的新选择。
Stars: ✭ 21 (+31.25%)
discord-downloader-goA Discord bot program to download and otherwise handle files sent in Discord channels with extensive configuration. Can be used as a genuine Discord Bot or user account / self-bot
Stars: ✭ 169 (+956.25%)
vsco-scraperEasily allows for scraping a VSCO
Stars: ✭ 106 (+562.5%)
VividlModern Windows GUI for youtube-dl/ yt-dlp
Stars: ✭ 189 (+1081.25%)
PyroGramBotpluggable Telegram Bot based on Pyrogram
Stars: ✭ 168 (+950%)
robotstxtrobots.txt file parsing and checking for R
Stars: ✭ 65 (+306.25%)
Ppspiderweb spider built by puppeteer, support task-queue and task-scheduling by decorators,support nedb / mongodb, support data visualization; 基于puppeteer的web爬虫框架,提供灵活的任务队列管理调度方案,提供便捷的数据保存方案(nedb/mongodb),提供数据可视化和用户交互的实现方案
Stars: ✭ 237 (+1381.25%)
MusicSpiderMusic Spider. Go 👾 Music Spider 是使用Golang写的音乐聚合爬虫,目前支持的站点包括 网易、QQ、虾米、酷狗、百度。
Stars: ✭ 24 (+50%)
ZDriveSeamless download/upload contents via Google Drive 📂
Stars: ✭ 25 (+56.25%)
image-downloaderA Nodejs module for downloading image to disk from a given URL
Stars: ✭ 61 (+281.25%)
factoryDocker microservice & Crawler by scrapy
Stars: ✭ 56 (+250%)
scraper图片爬取下载工具,极速爬取下载 站酷https://www.zcool.com.cn/, CNU 视觉 http://www.cnu.cc/ 设计师/用户 上传的 图片/照片/插画。
Stars: ✭ 64 (+300%)
js block研究学习各种拦截:反爬虫、拦截ad、防广告注入、斗黄牛等
Stars: ✭ 59 (+268.75%)
Jd mask robot京东口罩库存监控爬虫(非selenium),扫码登录、查价、加购、下单、秒杀
Stars: ✭ 216 (+1250%)
youdao有道词典网页爬虫
Stars: ✭ 22 (+37.5%)
LspiderLSpider 一个为被动扫描器定制的前端爬虫
Stars: ✭ 214 (+1237.5%)
zhihu-crawler徒手实现定时爬取知乎,从中发掘有价值的信息,并可视化爬取的数据作网页展示。
Stars: ✭ 56 (+250%)
1click-webpage-screenshotEntire page Screenshot extension for Google Chrome. I'm developing open source extension for Google Chrome. All extension are free for use. Let's make Chrome great again!
Stars: ✭ 432 (+2600%)
seenreqGenerate an object for testing if a request is sent, request is Mikeal's request.
Stars: ✭ 42 (+162.5%)
dslrbrowser-iosDSLR Browser iOS app to discover and connect to your Wi-Fi and DLNA enabled (Canon) camera
Stars: ✭ 17 (+6.25%)
PTT-CrawlerA web crawler specifically for PTT website.
Stars: ✭ 15 (-6.25%)
spiderpython 爬虫(amazon, confluence ...)
Stars: ✭ 21 (+31.25%)