All Projects → prabeesh → SparkTwitterAnalysis

prabeesh / SparkTwitterAnalysis

Licence: Apache-2.0 license
An Apache Spark standalone application using the Spark API in Scala. The application uses Simple Build Tool(SBT) for building the project.

Programming Languages

scala
5932 projects
shell
77523 projects

Projects that are alternatives of or similar to SparkTwitterAnalysis

Mobius
C# and F# language binding and extensions to Apache Spark
Stars: ✭ 929 (+3103.45%)
Mutual labels:  apache-spark, bigdata
Azure Event Hubs Spark
Enabling Continuous Data Processing with Apache Spark and Azure Event Hubs
Stars: ✭ 140 (+382.76%)
Mutual labels:  apache-spark, bigdata
Spark Streaming Monitoring With Lightning
Plot live-stats as graph from ApacheSpark application using Lightning-viz
Stars: ✭ 15 (-48.28%)
Mutual labels:  apache-spark, bigdata
Twitwork
Monitor twitter stream
Stars: ✭ 133 (+358.62%)
Mutual labels:  twitter-api, bigdata
spark-twitter-sentiment-analysis
Sentiment Analysis of a Twitter Topic with Spark Structured Streaming
Stars: ✭ 55 (+89.66%)
Mutual labels:  apache-spark, twitter-api
leaflet heatmap
简单的可视化湖州通话数据 假设数据量很大,没法用浏览器直接绘制热力图,把绘制热力图这一步骤放到线下计算分析。使用Apache Spark并行计算数据之后,再使用Apache Spark绘制热力图,然后用leafletjs加载OpenStreetMap图层和热力图图层,以达到良好的交互效果。现在使用Apache Spark实现绘制,可能是Apache Spark不擅长这方面的计算或者是我没有设计好算法,并行计算的速度比不上单机计算。Apache Spark绘制热力图和计算代码在这 https://github.com/yuanzhaokang/ParallelizeHeatmap.git .
Stars: ✭ 13 (-55.17%)
Mutual labels:  apache-spark, bigdata
Spark
.NET for Apache® Spark™ makes Apache Spark™ easily accessible to .NET developers.
Stars: ✭ 1,721 (+5834.48%)
Mutual labels:  apache-spark, bigdata
SparkProgrammingInScala
Apache Spark Course Material
Stars: ✭ 57 (+96.55%)
Mutual labels:  apache-spark, bigdata
twitter-stream-rs
A Rust library for listening on Twitter Streaming API.
Stars: ✭ 66 (+127.59%)
Mutual labels:  twitter-api, twitter-streaming-api
Sparkrdma
RDMA accelerated, high-performance, scalable and efficient ShuffleManager plugin for Apache Spark
Stars: ✭ 215 (+641.38%)
Mutual labels:  apache-spark, bigdata
Splash
Splash, a flexible Spark shuffle manager that supports user-defined storage backends for shuffle data storage and exchange
Stars: ✭ 105 (+262.07%)
Mutual labels:  apache-spark, bigdata
twitter-like-bot
This app allows you to automate Twitter liking for specific keywords, hashtags, or even full sentences. The bot uses streaming API which means that everything happens in real time.
Stars: ✭ 30 (+3.45%)
Mutual labels:  twitter-api, twitter-streaming-api
Bigdata Playground
A complete example of a big data application using : Kubernetes (kops/aws), Apache Spark SQL/Streaming/MLib, Apache Flink, Scala, Python, Apache Kafka, Apache Hbase, Apache Parquet, Apache Avro, Apache Storm, Twitter Api, MongoDB, NodeJS, Angular, GraphQL
Stars: ✭ 177 (+510.34%)
Mutual labels:  apache-spark, twitter-api
gan deeplearning4j
Automatic feature engineering using Generative Adversarial Networks using Deeplearning4j and Apache Spark.
Stars: ✭ 19 (-34.48%)
Mutual labels:  apache-spark, bigdata
twitter-stream
A Go wrapper for Twitter's V2 Filtered Stream API
Stars: ✭ 26 (-10.34%)
Mutual labels:  twitter-api, twitter-streaming-api
ml-flashcards
Extracting data from Twitter for #machinelearningflashcards 🤖
Stars: ✭ 35 (+20.69%)
Mutual labels:  twitter-api
spotatweet
A Spotify & Twitter API mashup showing what people are listening to now. Written in Node.js.
Stars: ✭ 26 (-10.34%)
Mutual labels:  twitter-api
github-readme-twitter
Add Twitter to your github readme
Stars: ✭ 73 (+151.72%)
Mutual labels:  twitter-api
eleventy-plugin-embed-tweet
A plugin for embedding tweets on the server side during build time
Stars: ✭ 24 (-17.24%)
Mutual labels:  twitter-api
recyclebin
♻️ measures usage of a particular term on twitter
Stars: ✭ 21 (-27.59%)
Mutual labels:  twitter-streaming-api

SparkTwitterAnalysis

A standalone application using the Spark API in Scala. The application uses Simple Build Tool(SBT) for building the project.

Using sbt-assembly plugin, Create a fat JAR of your project with all of its dependencies.

In sbt use the command assembly to create a fat JAR

sbt/sbt assembly

For more details refer this post

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].