All Projects → chenjiandongx → Mzitu

chenjiandongx / Mzitu

👧 美女写真套图爬虫(二)

Programming Languages

python
139335 projects - #7 most used programming language

Labels

Projects that are alternatives of or similar to Mzitu

Scrapyrt
HTTP API for Scrapy spiders
Stars: ✭ 637 (-30.76%)
Mutual labels:  crawler
Crawler
A high performance web crawler in Elixir.
Stars: ✭ 781 (-15.11%)
Mutual labels:  crawler
Python
Python脚本。模拟登录知乎, 爬虫,操作excel,微信公众号,远程开机
Stars: ✭ 7,355 (+699.46%)
Mutual labels:  crawler
Grab Site
The archivist's web crawler: WARC output, dashboard for all crawls, dynamic ignore patterns
Stars: ✭ 680 (-26.09%)
Mutual labels:  crawler
Creeper
🐾 Creeper - The Next Generation Crawler Framework (Go)
Stars: ✭ 762 (-17.17%)
Mutual labels:  crawler
Lulu
[Unmaintained] A simple and clean video/music/image downloader 👾
Stars: ✭ 789 (-14.24%)
Mutual labels:  crawler
Icrawler
A multi-thread crawler framework with many builtin image crawlers provided.
Stars: ✭ 629 (-31.63%)
Mutual labels:  crawler
Finalrecon
The Last Web Recon Tool You'll Need
Stars: ✭ 888 (-3.48%)
Mutual labels:  crawler
Pxer
A tool for pixiv.net. 人人可用的P站爬虫
Stars: ✭ 776 (-15.65%)
Mutual labels:  crawler
Torbot
Dark Web OSINT Tool
Stars: ✭ 821 (-10.76%)
Mutual labels:  crawler
Xalpha
基金投资管理回测引擎
Stars: ✭ 683 (-25.76%)
Mutual labels:  crawler
Fetchbot
A simple and flexible web crawler that follows the robots.txt policies and crawl delays.
Stars: ✭ 753 (-18.15%)
Mutual labels:  crawler
Instagram Profilecrawl
📝 quickly crawl the information (e.g. followers, tags etc...) of an instagram profile.
Stars: ✭ 816 (-11.3%)
Mutual labels:  crawler
Spidr
A versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.
Stars: ✭ 656 (-28.7%)
Mutual labels:  crawler
Psi Report
Crawls a website, gets PageSpeed Insights data for each page, and exports an HTML report.
Stars: ✭ 6 (-99.35%)
Mutual labels:  crawler
Price Monitor
京东商品价格监控:监控用户设定商品价格,降价邮件/微信提醒。技术:Python爬虫/IP代理池/JS接口爬取/Selenium页面爬取
Stars: ✭ 634 (-31.09%)
Mutual labels:  crawler
Gospider
Gospider - Fast web spider written in Go
Stars: ✭ 785 (-14.67%)
Mutual labels:  crawler
Fscrawler
Elasticsearch File System Crawler (FS Crawler)
Stars: ✭ 906 (-1.52%)
Mutual labels:  crawler
Zhihu Crawler
zhihu-crawler是一个基于Java的高性能、支持免费http代理池、支持横向扩展、分布式爬虫项目
Stars: ✭ 890 (-3.26%)
Mutual labels:  crawler
Py3 scripts
Life is short, *****.
Stars: ✭ 5 (-99.46%)
Mutual labels:  crawler

美女写真套图爬虫(二)

传送门:美女写真套图爬虫(一)

爬取网站 : http://www.mzitu.com

爬取全站 3000 多套图片,整整 10 个G

有图有真相

79076 张图片,假设你在每张图片上停留的时间为 2 秒,你需要连续看 2636 分钟,也就是 43.9 个小时才能看完。身体要紧不能太拼命!

以为这样就完了?

too young too simple sometimes naive!

我对套图名字产生了兴趣 将套图名分词后统计词频并进行处理 对词频数超过 100 的词语生成条形图

看来命名也就要讲究技巧的 名字一定要足够吸引眼球
性感 写真 美女 诱惑 妹子 这五个词拿下前五名 得票均超过 300,美腿 清纯 女神 紧跟其后,岛国 日本 也出现在其中,嫩模 以 102 票搭上了末班车

然后我又统计了代表着妹子胸围的 字母 生成了条形图

G 真的是一柱擎天,EF 排在第二梯队。我们再来看看胸围的百分比情况

G 的比例是最大的,高达 42%,E 加上 F 也基本上有半壁江山了

视觉冲击还不够大? 那来一张词云吧

这图真的不忍直视阿

最后请允许我真心说一句

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].