taogeT / Livetv_mining
Licence: apache-2.0
直播网站数据采集
Stars: ✭ 188
Programming Languages
Projects that are alternatives of or similar to Livetv mining
Saas Base
SaaS base application (Flask, Vue, Bootstrap, Webpack)
Stars: ✭ 208 (+10.64%)
Mutual labels: webpack, flask
Docker Web Framework Examples
Example apps that demonstate how to use Docker with your favorite web frameworks.
Stars: ✭ 204 (+8.51%)
Mutual labels: webpack, flask
React News Board
🌀 A Full-Stack Web App built with React and Flask.
Stars: ✭ 389 (+106.91%)
Mutual labels: webpack, flask
Flask Vuejs Madblog
基于 Flask 和 Vue.js 前后端分离的微型博客项目，支持多用户、Markdown文章（喜欢/收藏文章）、粉丝关注、用户评论（点赞）、动态通知、站内私信、黑名单、邮件支持、管理后台、权限管理、RQ任务队列、Elasticsearch全文搜索、Linux VPS部署、Docker容器部署等
Stars: ✭ 541 (+187.77%)
Mutual labels: webpack, flask
Cookiecutter Flask
A flask template with Bootstrap 4, asset bundling+minification with webpack, starter templates, and registration/authentication. For use with cookiecutter.
Stars: ✭ 3,967 (+2010.11%)
Mutual labels: webpack, flask
Python Tutorial
🏃 Some of the python tutorial - 《Python学习笔记》
Stars: ✭ 122 (-35.11%)
Mutual labels: scrapy, flask
Word2vec Spam Filter
Using word vectors to classify spam messages
Stars: ✭ 149 (-20.74%)
Mutual labels: webpack, flask
React Universal Saga
Universal React Starter Kit ft. Redux Saga
Stars: ✭ 184 (-2.13%)
Mutual labels: webpack
Marmot
💐Marmot | Web Crawler/HTTP protocol Download Package 🐭
Stars: ✭ 186 (-1.06%)
Mutual labels: scrapy
Gas Clasp Starter
A starter template for Google Apps Script by clasp
Stars: ✭ 184 (-2.13%)
Mutual labels: webpack
Supplychainpy
Supplychainpy is a Python library for supply chain analysis, modelling and simulation. The library assists a workflow that is reliant on Excel and VBA.
Stars: ✭ 184 (-2.13%)
Mutual labels: flask
React Molin
react-molin是一个全新的基于webpack3、react15、react-router4、antd-mobile的前端架构实现方案（h5）
Stars: ✭ 184 (-2.13%)
Mutual labels: webpack
Flask table
Because writing HTML is fiddly and all of your tables are basically the same
Stars: ✭ 187 (-0.53%)
Mutual labels: flask
Webpack Livereload Plugin
LiveReload during webpack --watch
Stars: ✭ 183 (-2.66%)
Mutual labels: webpack
Sass Extract
Extract structured variables from sass files
Stars: ✭ 183 (-2.66%)
Mutual labels: webpack
Scrapydweb
Web app for Scrapyd cluster management, Scrapy log analysis & visualization, Auto packaging, Timer tasks, Monitor & Alert, and Mobile UI. DEMO 👉
Stars: ✭ 2,385 (+1168.62%)
Mutual labels: scrapy
Bedrock
Build a Node web app with user authentication, security, and more in under 10 minutes. Now supports React Hot Loading for super-fast development. 👌
Stars: ✭ 187 (-0.53%)
Mutual labels: webpack
关于项目
介绍
项目实现爬虫、数据挖掘/分析等功能。目前主要是扫描直播站点收集数据，后续会开发相关数据分析模块。
架构采用前后端分离，通过RESTFul API通信。前端Vue+Webpack，后端Flask。
文件结构分为三部分，每个部分可以单独提供服务：
- frontend 前端代码，使用Vue+Webpack开发管理。
- server 后端RESTFul服务，使用Flask搭建提供API。
- crawler 爬虫服务，使用框架scrapy对直播站点爬取数据。
使用中有问题或更新建议，欢迎提issue或用以下联系方式跟我交流：
- 邮件: [email protected]
- QQ: 3084582097
历程
- 2017-05-10 开发新爬虫火猫。
- 2017-04-24 全民收集开发完成。
- 2017-04-22 熊猫收集开发完成。
- 2017-04-20 斗鱼收集开发完成。
- 2017-04-15 准备开发收集站点房间：关注数、公告、上一次开播时间、打赏值、开播当天人气中位数。
- 2017-04-01 变更LICENSE：GPL -> Apache。
- 2017-03-20 开发新爬虫全民。
- 2017-03-03 开发新爬虫龙珠。
- 2017-03-01 恢复爬虫熊猫、战旗。
- 2017-01-07 完成全部功能迁移，前后端分离完成。
- 2016-12-24 引入vuex进行state和权限管理。
- 2016-12-15 引入vue-resource，主模块(Main)完成分离。
- 2016-11-25 研究流行前端框架和开发方式，确定使用webpack开发。
- 2016-11-20 重新设计结构，进行前后端分离。
- 2016-11-01 修正改造搜索功能，需要登录后才能使用。
- 2016-10-29 完成渲染初步改造，已实现调用REST API进行访问读取。爬虫运行间隔20分钟。
- 2016-10-20 引入Vue.js，改造前端渲染方式，减轻服务器压力。开发完成简单 Flask-Vue 插件。
- 2016-10-15 引入Scrapy重构爬虫，精简爬虫步骤。仅保留斗鱼、BiliBli爬虫。
2016-08-15 v1.0版本开发结束，代码保存在分支v1.0
捐助开发者
如果你喜欢我的作品 or 站点对你有所帮助，希望能支持我一下。
| 微信 | 支付宝 |
|---|---|
 |
 |
Note that the project description data, including the texts, logos, images, and/or trademarks,
for each open source project belongs to its rightful owner.
If you wish to add or remove any projects, please contact us at [email protected].