All Projects → dev-techmoe → Python Dcdownloader

dev-techmoe / Python Dcdownloader

Licence: mit
由Python编写的全异步实现的动漫之家(dmzj)漫画批量下载器(爬虫)

Programming Languages

python
139335 projects - #7 most used programming language

Projects that are alternatives of or similar to Python Dcdownloader

Annie
👾 Fast and simple video download library and CLI tool written in Go
Stars: ✭ 16,369 (+11111.64%)
Mutual labels:  crawler, downloader
TumblTwo
TumblTwo, an Improved Fork of TumblOne, a Tumblr Downloader.
Stars: ✭ 57 (-60.96%)
Mutual labels:  crawler, downloader
Tumblthree
A Tumblr Backup Application
Stars: ✭ 211 (+44.52%)
Mutual labels:  crawler, downloader
Laosj
golang light-weight image crawler
Stars: ✭ 199 (+36.3%)
Mutual labels:  crawler, downloader
Tumblthree
A Tumblr Blog Backup Application
Stars: ✭ 923 (+532.19%)
Mutual labels:  crawler, downloader
Pornhub Downloader
Download videos from pornhub.
Stars: ✭ 346 (+136.99%)
Mutual labels:  crawler, downloader
img-cli
An interactive Command-Line Interface Build in NodeJS for downloading a single or multiple images to disk from URL
Stars: ✭ 15 (-89.73%)
Mutual labels:  crawler, downloader
Moodle Downloader 2
A Moodle downloader that downloads course content fast from Moodle (eg. lecture pdfs)
Stars: ✭ 118 (-19.18%)
Mutual labels:  crawler, downloader
Lulu
[Unmaintained] A simple and clean video/music/image downloader 👾
Stars: ✭ 789 (+440.41%)
Mutual labels:  crawler, downloader
Bilili
🍻 bilibili video (including bangumi) and danmaku downloader | B站视频(含番剧)、弹幕下载器
Stars: ✭ 379 (+159.59%)
Mutual labels:  crawler, downloader
Work crawler
Download comics novels 小说漫画下载工具 小説漫画のダウンローダ 小說漫畫下載:腾讯漫画 大角虫漫画 有妖气 知音漫客 咪咕 SF漫画 哦漫画 看漫画 漫画柜 汗汗酷漫 動漫伊甸園 快看漫画 微博动漫 733动漫网 大古漫画网 漫画DB 無限動漫 動漫狂 卡推漫画 动漫之家 动漫屋 古风漫画网 36漫画网 亲亲漫画网 乙女漫画 comico webtoons 咚漫 ニコニコ静画 ComicWalker ヤングエースUP モアイ pixivコミック サイコミ;アルファポリス カクヨム ハーメルン 小説家になろう 起点中文网 八一中文网 顶点小说 落霞小说网 努努书坊 笔趣阁→epub.
Stars: ✭ 1,224 (+738.36%)
Mutual labels:  crawler, downloader
4chan Downloader
Python3 script to continuously download all images/webms of multiple 4chan thread simultaneously - without installation
Stars: ✭ 136 (-6.85%)
Mutual labels:  crawler, downloader
Search
An Open Source Search Engine
Stars: ✭ 139 (-4.79%)
Mutual labels:  crawler
Crawler China Mainland Universities
中国大陆大学列表爬虫
Stars: ✭ 143 (-2.05%)
Mutual labels:  crawler
Edx Dl
A simple tool to download video lectures from edx.org (and other openedx sites)
Stars: ✭ 1,769 (+1111.64%)
Mutual labels:  downloader
Go spider
[爬虫框架 (golang)] An awesome Go concurrent Crawler(spider) framework. The crawler is flexible and modular. It can be expanded to an Individualized crawler easily or you can use the default crawl components only.
Stars: ✭ 1,745 (+1095.21%)
Mutual labels:  crawler
Ipadownloadtool
输入下载页面链接自动解析ipa下载地址,支持本地下载,支持蒲公英和fir及其他所有自定义下载页面(由于是通过拦截webView的itms-services://请求获取plist文件,因此理论上可无视所有的请求加密、校验措施,支持各类企业版、内测包ipa下载)
Stars: ✭ 145 (-0.68%)
Mutual labels:  downloader
Google Play Scraper
Google play scraper for Python inspired by <facundoolano/google-play-scraper>
Stars: ✭ 143 (-2.05%)
Mutual labels:  crawler
Koreanewscrawler
대량의 뉴스 데이터를 수집하기 위해 만들어진 뉴스 크롤러입니다.
Stars: ✭ 138 (-5.48%)
Mutual labels:  crawler
Electron Youtube To Mp3 Converter
Electron Youtube to Mp3 Converter and downloader
Stars: ✭ 137 (-6.16%)
Mutual labels:  downloader

DCDownloader

python GitHub license Build Status GitHub stars

专注于漫画网站、图站等类似形式的内容站点的批量下载器框架。

说明

这个项目最开始是作者编写的一个仅支持某个漫画网站的批量下载器,后来有人提建议说有增加网站的需求,作者便重新梳理了一下思路重构了代码,使其作为一种框架形式存在。DCDownloader是目前一款异步实现的、支持自定义适配的,专注于漫画网站、图站等类似形式的内容站点的批量下载器。通过编写Parser来做到适配不同的网站。
目前项目中内置了三个Parser,分别是

  • SimpleParser 一个Parser的例子,希望自己编写Parser的话可以参考这个的实现,同时也应用于单元测试过程中。
  • DmzjParser 动漫之家漫画站(非原创区)
  • EhentaiParser Ehentai

安装

Windows

exe可执行文件下载

Linux/OSX

请确认您本机已安装python和pip并且python版本大于3.4.3

$ pip3 install https://github.com/dev-techmoe/python-dcdownloader/archive/master.zip
$ dcdownloader -h

可用命令

usage: dcdownloader [-h] [--proxy PROXY] [--no-verify-ssl] [-v] [-V] [--fetch-only]
               URL [OUTPUT_PATH]

positional arguments:
  URL              target URL
  OUTPUT_PATH      output path of downloaded file (default: current directory)

optional arguments:
  -h, --help       show this help message and exit
  --proxy PROXY    HTTP proxy address for connection
  --no-verify-ssl  Disable the SSL certificate verifying when connecting
  -v, --version    show version
  -V, --verbose    show more running detail
  --fetch-only     Ignore all download process (only fetch chapter and image urls)

免责声明

这个项目更多的其实是作为作者个人的练习项目存在,方便使用只是其二。为了不对目标站造成困扰,作者已将默认并发数设置到了一个作者认为不会对目标站造成影响的程度。由于使用者自身使用所造成的问题作者不付任何责任,同时作者不对任何下载内容承担任何责任。

贡献

本项目欢迎提交pr,非常希望您能够帮助改善本项目。您可以帮助我来适配更多的网站,但是我目前不希望用来解析收录原创漫画站的Parser,还请见谅。

License

MIT

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].