All Projects → JimSunJing → Douban_crawler

JimSunJing / Douban_crawler

Licence: mit
备份豆瓣计划

Programming Languages

python
139335 projects - #7 most used programming language

Projects that are alternatives of or similar to Douban crawler

douban-movie
Get movie info from douban(豆瓣) and display in your terminal
Stars: ✭ 17 (-86.29%)
Mutual labels:  spider, douban
Videospider
抓取豆瓣,bilibili等中的电视剧、电影、动漫演员等信息
Stars: ✭ 186 (+50%)
Mutual labels:  spider, douban
Douban Movie
Golang爬虫 爬取豆瓣电影Top250
Stars: ✭ 114 (-8.06%)
Mutual labels:  spider, douban
goSpider
some small project and some articles
Stars: ✭ 56 (-54.84%)
Mutual labels:  spider, douban
Douban spider
一个简单的豆瓣信息爬虫😄
Stars: ✭ 8 (-93.55%)
Mutual labels:  spider, douban
Scrala
Unmaintained 🐳 ☕️ 🕷 Scala crawler(spider) framework, inspired by scrapy, created by @gaocegege
Stars: ✭ 113 (-8.87%)
Mutual labels:  spider
Examples Of Web Crawlers
一些非常有趣的python爬虫例子,对新手比较友好,主要爬取淘宝、天猫、微信、豆瓣、QQ等网站。(Some interesting examples of python crawlers that are friendly to beginners. )
Stars: ✭ 10,724 (+8548.39%)
Mutual labels:  spider
Cockroach
又一个 java 内容(pa)获取(chong)工具
Stars: ✭ 112 (-9.68%)
Mutual labels:  spider
Jobs Search
🕷招聘网站爬虫合集,不定期更新分支
Stars: ✭ 111 (-10.48%)
Mutual labels:  spider
Crawlab Lite
Lite version of Crawlab. 轻量版 Crawlab 爬虫管理平台
Stars: ✭ 122 (-1.61%)
Mutual labels:  spider
Wechat article
爬取微信公众号文章
Stars: ✭ 121 (-2.42%)
Mutual labels:  spider
House Price Prediction
房价预测完整项目:1.爬取链家网数据 2.处理后,用sklearn中几个逻辑回归机器学习模型和keras神经网络搭建模型预测房价 最终结果神经网络效果更好,R^2值0.75左右
Stars: ✭ 116 (-6.45%)
Mutual labels:  spider
Douyin Api
抖音API、抖音数据、抖音直播数据、抖音直播Api、抖音视频Api、抖音爬虫、抖音去水印、抖音视频下载、抖音视频解析、抖音直播监控、抖音数据采集
Stars: ✭ 112 (-9.68%)
Mutual labels:  spider
Copybook
用爬虫爬取小说网站上所有小说,存储到数据库中,并用爬到的数据构建自己的小说网站
Stars: ✭ 117 (-5.65%)
Mutual labels:  spider
Pkulaw spider
爬取北大法宝网http://www.pkulaw.cn/Case/
Stars: ✭ 113 (-8.87%)
Mutual labels:  spider
Pddspider
拼多多爬虫,爬取所有商品、评论等信息
Stars: ✭ 121 (-2.42%)
Mutual labels:  spider
Baiduspider
BaiduSpider,一个爬取百度搜索结果的爬虫,目前支持百度网页搜索,百度图片搜索,百度知道搜索,百度视频搜索,百度资讯搜索,百度文库搜索,百度经验搜索和百度百科搜索。
Stars: ✭ 105 (-15.32%)
Mutual labels:  spider
Dingdian
Python爬虫和Flask实现小说网站
Stars: ✭ 115 (-7.26%)
Mutual labels:  spider
Free proxy website
获取免费socks/https/http代理的网站集合
Stars: ✭ 119 (-4.03%)
Mutual labels:  spider
Bilibili member crawler
B站用户爬虫 好耶~是爬虫
Stars: ✭ 115 (-7.26%)
Mutual labels:  spider

Douban Crawler

What is it?

It is a very simple crawler in order to back-up one's DouBan account considering douban accounts might be blocked without any notification in Douban.

为了防止被豆瓣未告知便封禁账号,写了这个简单的爬虫脚本。

Function

  • DouBan Movie Back-up
  • DouBan Reading Back-up
  • DouBan Music Back-up
  • DouBan Broadcast clawer
  • DouBan Diary Back-up
  • DouBan Critique Back-up
  • Movie label feature
  • Book label feature
  • DouBan Dou-List back-up

Install

  • 安装python、pip
  • 切换项目目录
cd {project_path}/douban_crawler
pip install virtualenv
virtualenv venv
source venv/bin/activate
pip install -r requirements.txt
python personalCrawler.py

Application

DouBan Run Away Plan

use personalCrawler.py backup douban book+movie marking and import csv into Notion.

Book, Movie, Music Planing System base on Douban & Notion

use doulist.py download doulist, import into notion calender template create a planing system.

About

  • 这个小小的项目结束~~
Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].