All Projects → CUHKSZ-TQL → Weibospider_sentimentanalysis

CUHKSZ-TQL / Weibospider_sentimentanalysis

借助Python抓取微博数据,并对抓取的数据进行情绪分析

Projects that are alternatives of or similar to Weibospider sentimentanalysis

Lstm Sentiment Analysis
Sentiment Analysis with LSTMs in Tensorflow
Stars: ✭ 886 (+412.14%)
Mutual labels:  jupyter-notebook, sentiment-analysis
Text Analytics With Python
Learn how to process, classify, cluster, summarize, understand syntax, semantics and sentiment of text data with the power of Python! This repository contains code and datasets used in my book, "Text Analytics with Python" published by Apress/Springer.
Stars: ✭ 1,132 (+554.34%)
Mutual labels:  jupyter-notebook, sentiment-analysis
Neural Networks
All about Neural Networks!
Stars: ✭ 34 (-80.35%)
Mutual labels:  jupyter-notebook, sentiment-analysis
Getting Things Done With Pytorch
Jupyter Notebook tutorials on solving real-world problems with Machine Learning & Deep Learning using PyTorch. Topics: Face detection with Detectron 2, Time Series anomaly detection with LSTM Autoencoders, Object Detection with YOLO v5, Build your first Neural Network, Time Series forecasting for Coronavirus daily cases, Sentiment Analysis with BERT.
Stars: ✭ 738 (+326.59%)
Mutual labels:  jupyter-notebook, sentiment-analysis
Programer log
最新动态在这里【我的程序员日志】
Stars: ✭ 112 (-35.26%)
Mutual labels:  jupyter-notebook, scrapy
Twitter sentiment analysis word2vec convnet
Twitter Sentiment Analysis with Gensim Word2Vec and Keras Convolutional Network
Stars: ✭ 24 (-86.13%)
Mutual labels:  jupyter-notebook, sentiment-analysis
Sentiment Analysis Nltk Ml Lstm
Sentiment Analysis on the First Republic Party debate in 2016 based on Python,NLTK and ML.
Stars: ✭ 61 (-64.74%)
Mutual labels:  jupyter-notebook, sentiment-analysis
Deep Learning V2 Pytorch
Projects and exercises for the latest Deep Learning ND program https://www.udacity.com/course/deep-learning-nanodegree--nd101
Stars: ✭ 4,457 (+2476.3%)
Mutual labels:  jupyter-notebook, sentiment-analysis
Tia
Your Advanced Twitter stalking tool
Stars: ✭ 98 (-43.35%)
Mutual labels:  jupyter-notebook, sentiment-analysis
Experiments
Some research experiments
Stars: ✭ 95 (-45.09%)
Mutual labels:  jupyter-notebook, scrapy
Deep Learning For Hackers
Machine Learning tutorials with TensorFlow 2 and Keras in Python (Jupyter notebooks included) - (LSTMs, Hyperameter tuning, Data preprocessing, Bias-variance tradeoff, Anomaly Detection, Autoencoders, Time Series Forecasting, Object Detection, Sentiment Analysis, Intent Recognition with BERT)
Stars: ✭ 586 (+238.73%)
Mutual labels:  jupyter-notebook, sentiment-analysis
Amazon Product Recommender System
Sentiment analysis on Amazon Review Dataset available at http://snap.stanford.edu/data/web-Amazon.html
Stars: ✭ 158 (-8.67%)
Mutual labels:  jupyter-notebook, sentiment-analysis
Easy Scraping Tutorial
Simple but useful Python web scraping tutorial code.
Stars: ✭ 583 (+236.99%)
Mutual labels:  jupyter-notebook, scrapy
Happiness Prediction
Sentimental analysis using keras in python
Stars: ✭ 25 (-85.55%)
Mutual labels:  jupyter-notebook, sentiment-analysis
Sentiment analysis fine grain
Multi-label Classification with BERT; Fine Grained Sentiment Analysis from AI challenger
Stars: ✭ 546 (+215.61%)
Mutual labels:  jupyter-notebook, sentiment-analysis
Machine Learning From Scratch
Succinct Machine Learning algorithm implementations from scratch in Python, solving real-world problems (Notebooks and Book). Examples of Logistic Regression, Linear Regression, Decision Trees, K-means clustering, Sentiment Analysis, Recommender Systems, Neural Networks and Reinforcement Learning.
Stars: ✭ 42 (-75.72%)
Mutual labels:  jupyter-notebook, sentiment-analysis
Afinn
AFINN sentiment analysis in Python
Stars: ✭ 356 (+105.78%)
Mutual labels:  jupyter-notebook, sentiment-analysis
Sentimentanalysis
文本情感分析
Stars: ✭ 421 (+143.35%)
Mutual labels:  jupyter-notebook, sentiment-analysis
Turkish Bert Nlp Pipeline
Bert-base NLP pipeline for Turkish, Ner, Sentiment Analysis, Question Answering etc.
Stars: ✭ 85 (-50.87%)
Mutual labels:  jupyter-notebook, sentiment-analysis
Ajax Movie Recommendation System With Sentiment Analysis
Content-Based Recommender System recommends movies similar to the movie user likes and analyses the sentiments on the reviews given by the user for that movie.
Stars: ✭ 127 (-26.59%)
Mutual labels:  jupyter-notebook, sentiment-analysis

微博用户的行为与情感分析

借助Python抓取微博数据,并对抓取的数据进行情绪分析

第一部分:微博数据抓取

参考自https://github.com/nghuyong/WeiboSpider/tree/search

(一)利用高级搜索抓取指定微博

本部分请参考文件夹WeiboSpider中的内容

1.安装依赖:

mongodb
phantomjs
redis
requirements.txt
(安装好mongodb之后需要新建数据库sina

2.构建账号池

购买微博小号,购买链接http://www.xiaohao.shop/
将账号密码复制到 WeiboSpider/sina/account_build/account.txt\ 运行 WeiboSpider/sina/account_build/login.py 运行成功会显示cookie创建成功

3.自定义检索条件

修改 WeiboSpider/sina/redis_init.py 中的日期,关键词,运行该文件进行微博检索
(本项目默认抓取热门微博,如需更改可将url中的sort设置为time)

4.开始爬虫

运行 WeiboSpider/sina/spider/weibo_spider.py 抓取目标数据
建议采取多线程同时抓取,提高速度
Mac用户在命令行中输入 scrapy crawl weibo_spider
Windows用户在命令行中输入 scrapy runspider weibo_spider.py multi 5.检查抓取的数据

数据会存储在sina database中,collection下会有tweets(微博)comments(评论)account(账号) tweets comments

(二)根据用户id抓取任意微博

本部分请参考文件夹WeiboSpiderSimple中的内容

1.安装依赖:

mongodb
requirements.txt\

2.替换cookie:

访问 https://weibo.cn/ 并登陆,获取对应的cookie,将WeiboSpiderSimple/sina/settings.py中的cookie换成你自己获取到的cookie

3.指定爬取的用户ID

WeiboSpiderSimple/sina/spider/weibo_spider.py中的start_uids换成你想抓取的对象的微博ID。

4.开始爬虫

执行scrapy crawl weibo_spider或者直接在pycharm当中运行WeiboSpiderSimple/sina/spider/weibo_spider.py

第二部分:探索性分析

EDA.py

第三部分:评论情绪分析

Sentiment analysis.ipynb

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].