All Projects → xavierskip → hupu_Album_Downloader

xavierskip / hupu_Album_Downloader

Licence: other
虎扑网相册下载工具

Programming Languages

python
139335 projects - #7 most used programming language
HTML
75241 projects
CSS
56736 projects
javascript
184084 projects - #8 most used programming language

Projects that are alternatives of or similar to hupu Album Downloader

ChineseStarsRelationship
中国明星数据爬取。你甚至可以拿到互联网上所有的人之间的关系,接下来你可以自己发挥!基于这些数据,你可以完成更多有趣的事情。比如说社交网络分析,关系网络可视化,算法研究,和其他有意思的事情。Chinese star data crawling. You can even get all the people on the internet! Based on these data, you can do more interesting things. For example, social network analysis, relational network visualization, algorithm research, and other interesting things.
Stars: ✭ 26 (+52.94%)
Mutual labels:  spider
Spydan
A web spider for shodan.io without using the Developer API.
Stars: ✭ 30 (+76.47%)
Mutual labels:  spider
jobSpider
jobSpider是一只scrapy爬虫,用于爬取职位信息
Stars: ✭ 28 (+64.71%)
Mutual labels:  spider
OpenYspider
千万级图片爬虫、视频爬虫 [开源版本] Image Spider
Stars: ✭ 122 (+617.65%)
Mutual labels:  spider
scrapy-distributed
A series of distributed components for Scrapy. Including RabbitMQ-based components, Kafka-based components, and RedisBloom-based components for Scrapy.
Stars: ✭ 38 (+123.53%)
Mutual labels:  spider
learning spider
这其实是一份学习笔记。包括学习记录、爬虫练习平台(网站)、自制工具脚本
Stars: ✭ 54 (+217.65%)
Mutual labels:  spider
node-html-crawler
Simple for use node html crawler (spider) of site web pages
Stars: ✭ 30 (+76.47%)
Mutual labels:  spider
zucc xk ZhengFang
ZUCC正方教务系统抢课助手。针对ZUCC正方教务系统模拟登录,爬取课程信息,自动抓包发包抢课。具体实现流程可参考README中的实现原理链接
Stars: ✭ 40 (+135.29%)
Mutual labels:  spider
landchina-spider
项目已经过时!无法应用在改版后的网站上。
Stars: ✭ 13 (-23.53%)
Mutual labels:  spider
youdao
有道词典网页爬虫
Stars: ✭ 22 (+29.41%)
Mutual labels:  spider
OpenScraper
An open source webapp for scraping: towards a public service for webscraping
Stars: ✭ 80 (+370.59%)
Mutual labels:  spider
douban-movie
Get movie info from douban(豆瓣) and display in your terminal
Stars: ✭ 17 (+0%)
Mutual labels:  spider
benchmark-http
No description or website provided.
Stars: ✭ 15 (-11.76%)
Mutual labels:  spider
photo-spider-scrapy
10 photo website spiders, 10 个国外图库的 scrapy 爬虫代码
Stars: ✭ 17 (+0%)
Mutual labels:  spider
MusicSpider
Music Spider. Go 👾 Music Spider 是使用Golang写的音乐聚合爬虫,目前支持的站点包括 网易、QQ、虾米、酷狗、百度。
Stars: ✭ 24 (+41.18%)
Mutual labels:  spider
spider-school
自动答题程序🎉
Stars: ✭ 37 (+117.65%)
Mutual labels:  spider
QQSpider
爬取QQ用户信息(qq号、昵称、生日、地址等基本信息)并做简要analysis。
Stars: ✭ 21 (+23.53%)
Mutual labels:  spider
rb-spider
基于 RabbitMQ 中间件的爬虫的 Ruby 实现 [Developing]
Stars: ✭ 13 (-23.53%)
Mutual labels:  spider
python-fxxk-spider
收集各种免费的 Python 爬虫项目
Stars: ✭ 184 (+982.35%)
Mutual labels:  spider
python-spider
python爬虫小项目【持续更新】【笔趣阁小说下载、Tweet数据抓取、天气查询、网易云音乐逆向、天天基金网查询、微博数据抓取(生成cookie)、有道翻译逆向、企查查免登陆爬虫、大众点评svg加密破解、B站用户爬虫、拉钩免登录爬虫、自如租房字体加密、知乎问答
Stars: ✭ 45 (+164.71%)
Mutual labels:  spider

虎扑网相册下载工具

虎扑相册现在需要登录才能浏览,所以下载工具需要指定能够登录的虎扑帐号。

usage:

python albumhupu.py <你想要下载的虎扑相册的url> -u [用户名] [密码]

第一次使用时会提示你输入虎扑帐号用户名和密码,登录后会记录此帐号的cookie,以后再登录时不需要输入帐号信息。cookie过期后会提示你重新输入帐号信息。 (注意此模块hupu会在自己的目录下记录登录帐号的cookies)。

默认情况下,下载的相册图片会保存在当前目录下,本地文件夹名称以虎扑相册文件夹为准。可以修改文件保存路径以及文件夹名称,请使用python albumhupu.py -h查看帮助。

runserver.py 运行 web 服务用来在网络上搭建此工具。

依赖 Flask网络框架,数据存储需要mysql。

# 抓取部分
requests
# 网络服务部分
Flask
PyMySQL
  1. 先运行 python web/db.py 初始化数据库
  2. 直接运行 python runserver.py 开启web服务

[web服务配置]

# flask 的配置文件
SECRET_KEY = 'YouNev3rKn0w!'
# 新浪微博连接登录的配置
APPKEY = 012345
APPSECRET = 'xxxxxxx'
REDIRECTURI = 'http://localhost'
# 数据库配置
HOST = '127.0.0.1'
PORT = 3306
DBUSER = 'root'
DBPASSWD = 'root'
DB = 'hupu'
# 抓取相册内容需要指定默认的虎扑帐号
LUSER = <username>
LPWD = <password>
Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].