4chan DownloaderPython3 script to continuously download all images/webms of multiple 4chan thread simultaneously - without installation
Stars: ✭ 136 (-6.85%)
img-cliAn interactive Command-Line Interface Build in NodeJS for downloading a single or multiple images to disk from URL
Stars: ✭ 15 (-89.73%)
TumblthreeA Tumblr Blog Backup Application
Stars: ✭ 923 (+532.19%)
Annie👾 Fast and simple video download library and CLI tool written in Go
Stars: ✭ 16,369 (+11111.64%)
TumblTwoTumblTwo, an Improved Fork of TumblOne, a Tumblr Downloader.
Stars: ✭ 57 (-60.96%)
Laosjgolang light-weight image crawler
Stars: ✭ 199 (+36.3%)
Bilili🍻 bilibili video (including bangumi) and danmaku downloader | B站视频(含番剧)、弹幕下载器
Stars: ✭ 379 (+159.59%)
TumblthreeA Tumblr Backup Application
Stars: ✭ 211 (+44.52%)
Moodle Downloader 2A Moodle downloader that downloads course content fast from Moodle (eg. lecture pdfs)
Stars: ✭ 118 (-19.18%)
Lulu[Unmaintained] A simple and clean video/music/image downloader 👾
Stars: ✭ 789 (+440.41%)
Work crawlerDownload comics novels 小说漫画下载工具 小説漫画のダウンローダ 小說漫畫下載:腾讯漫画 大角虫漫画 有妖气 知音漫客 咪咕 SF漫画 哦漫画 看漫画 漫画柜 汗汗酷漫 動漫伊甸園 快看漫画 微博动漫 733动漫网 大古漫画网 漫画DB 無限動漫 動漫狂 卡推漫画 动漫之家 动漫屋 古风漫画网 36漫画网 亲亲漫画网 乙女漫画 comico webtoons 咚漫 ニコニコ静画 ComicWalker ヤングエースUP モアイ pixivコミック サイコミ;アルファポリス カクヨム ハーメルン 小説家になろう 起点中文网 八一中文网 顶点小说 落霞小说网 努努书坊 笔趣阁→epub.
Stars: ✭ 1,224 (+738.36%)
BbwebimageA high performance Swift library for downloading, caching and editing web images asynchronously.
Stars: ✭ 128 (-12.33%)
Edx DlA simple tool to download video lectures from edx.org (and other openedx sites)
Stars: ✭ 1,769 (+1111.64%)
DownloaderFast and reliable multipart downloader with asynchronous progress events for .NET applications.
Stars: ✭ 128 (-12.33%)
PixivfanboxdownloaderA Chrome extension for downloading files on Pixiv Fanbox in batches. Chrome 扩展,用于批量下载 Pixiv Fanbox 上的文件。
Stars: ✭ 125 (-14.38%)
Google Play ScraperGoogle play scraper for Python inspired by <facundoolano/google-play-scraper>
Stars: ✭ 143 (-2.05%)
SquidwarcSquidwarc is a high fidelity, user scriptable, archival crawler that uses Chrome or Chromium with or without a head
Stars: ✭ 125 (-14.38%)
Zhihu Spider一个获取知乎用户主页信息的多线程Python爬虫程序。
Stars: ✭ 137 (-6.16%)
Crawlab LiteLite version of Crawlab. 轻量版 Crawlab 爬虫管理平台
Stars: ✭ 122 (-16.44%)
Qqmusicspider基于Scrapy的QQ音乐爬虫(QQ Music Spider),爬取歌曲信息、歌词、精彩评论等,并且分享了QQ音乐中排名前6400名的内地和港台歌手的49万+的音乐语料
Stars: ✭ 120 (-17.81%)
InstagramdownloaderFirefox and Chrome Extention which creates an download button for instagram images and videos and videos
Stars: ✭ 144 (-1.37%)
Robots TxtDetermine if a page may be crawled from robots.txt, robots meta tags and robot headers
Stars: ✭ 142 (-2.74%)
Pspider简单易用的Python爬虫框架,QQ交流群:597510560
Stars: ✭ 1,611 (+1003.42%)
AgetAget - An Asynchronous Downloader
Stars: ✭ 121 (-17.12%)
SearchAn Open Source Search Engine
Stars: ✭ 139 (-4.79%)
Lyndor🚀 Powerful command line tool to download lynda.com courses for personal offline use. 〽️
Stars: ✭ 127 (-13.01%)
Go spider[爬虫框架 (golang)] An awesome Go concurrent Crawler(spider) framework. The crawler is flexible and modular. It can be expanded to an Individualized crawler easily or you can use the default crawl components only.
Stars: ✭ 1,745 (+1095.21%)
Ipadownloadtool输入下载页面链接自动解析ipa下载地址,支持本地下载,支持蒲公英和fir及其他所有自定义下载页面(由于是通过拦截webView的itms-services://请求获取plist文件,因此理论上可无视所有的请求加密、校验措施,支持各类企业版、内测包ipa下载)
Stars: ✭ 145 (-0.68%)
Novel GrabberNovel-Grabber can download novels from pretty much any webnovel and lightnovel site.
Stars: ✭ 125 (-14.38%)
Black WidowGUI based offensive penetration testing tool (Open Source)
Stars: ✭ 124 (-15.07%)
OnegramThis repository is no longer maintained.
Stars: ✭ 137 (-6.16%)
AxelAxel tries to accelerate the download process by using multiple
connections per file, and can also balance the load between
different servers.
Stars: ✭ 1,997 (+1267.81%)
Goclone Website Cloner - Utilizes powerful Go routines to clone websites to your computer within seconds.
Stars: ✭ 134 (-8.22%)
GenesisAlmighty Book Downloader
Stars: ✭ 120 (-17.81%)
Tiebamanager(已跑路)百度贴吧吧务管理工具,自动扫描帖子并处理违规帖
Stars: ✭ 119 (-18.49%)
Php CrawlerA php crawler that finds emails on the internets
Stars: ✭ 119 (-18.49%)
MassivedlDownload a large list of files concurrently
Stars: ✭ 141 (-3.42%)
NewspaperNews, full-text, and article metadata extraction in Python 3. Advanced docs:
Stars: ✭ 11,545 (+7807.53%)
Sentinel CrawlerXenomorph Crawler, a Concise, Declarative and Observable Distributed Crawler(Node / Go / Java / Rust) For Web, RDB, OS, also can act as a Monitor(with Prometheus) or ETL for Infrastructure 💫 多语言执行器,分布式爬虫
Stars: ✭ 118 (-19.18%)
Red hawkAll in one tool for Information Gathering, Vulnerability Scanning and Crawling. A must have tool for all penetration testers
Stars: ✭ 1,898 (+1200%)
Docs《数据采集从入门到放弃》源码。内容简介:爬虫介绍、就业情况、爬虫工程师面试题 ;HTTP协议介绍; Requests使用 ;解析器Xpath介绍; MongoDB与MySQL; 多线程爬虫; Scrapy介绍 ;Scrapy-redis介绍; 使用docker部署; 使用nomad管理docker集群; 使用EFK查询docker日志
Stars: ✭ 118 (-19.18%)
Youtube ProjectsThis repository contains all the code I use in my YouTube tutorials.
Stars: ✭ 144 (-1.37%)
OddishTo crawl all csgo skins from website.
Stars: ✭ 139 (-4.79%)
TtkdownloaderTTKDownloader that imitation xunlei downloader, based on Qt for windows and linux.
Stars: ✭ 131 (-10.27%)
Cumcomic updater, mangafied
Stars: ✭ 117 (-19.86%)
DecryptloginAPIs for loginning some websites by using requests.
Stars: ✭ 1,861 (+1174.66%)
Kobo Book DownloaderA tool to download your purchased Kobo books and remove the DRM from them.
Stars: ✭ 117 (-19.86%)
FiledownloaderMultitask、MultiThread(MultiConnection)、Breakpoint-resume、High-concurrency、Simple to use、Single/NotSingle-process
Stars: ✭ 10,408 (+7028.77%)