Cheap and reliable Node.js hosting starts at $3/month, and $1/month static HTML hosting

简单的可视化湖州通话数据假设数据量很大，没法用浏览器直接绘制热力图，把绘制热力图这一步骤放到线下计算分析。使用Apache Spark并行计算数据之后，再使用Apache Spark绘制热力图，然后用leafletjs加载OpenStreetMap图层和热力图图层，以达到良好的交互效果。现在使用Apache Spark实现绘制，可能是Apache Spark不擅长这方面的计算或者是我没有设计好算法，并行计算的速度比不上单机计算。Apache Spark绘制热力图和计算代码在这 https://github.com/yuanzhaokang/ParallelizeHeatmap.git .

Stars: ✭ 13 (-68.29%)

Mutual labels: spark, apache-spark

Sparklyr

R interface for Apache Spark

Stars: ✭ 775 (+1790.24%)

Mutual labels: spark, apache-spark

Kafka Storm Starter

Code examples that show to integrate Apache Kafka 0.8+ with Apache Storm 0.9+ and Apache Spark Streaming 1.1+, while using Apache Avro as the data serialization format.

Stars: ✭ 728 (+1675.61%)

Mutual labels: spark, apache-spark

Spark Jupyter Aws

A guide on how to set up Jupyter with Pyspark painlessly on AWS EC2 clusters, with S3 I/O support

Stars: ✭ 259 (+531.71%)

Mutual labels: spark, apache-spark

Spark Flamegraph

Easy CPU Profiling for Apache Spark applications

Stars: ✭ 30 (-26.83%)

Mutual labels: spark, apache-spark

spark-structured-streaming-examples

Spark structured streaming examples with using of version 3.0.0

Stars: ✭ 23 (-43.9%)

Mutual labels: spark, apache-spark

Learningsparkv2

This is the github repo for Learning Spark: Lightning-Fast Data Analytics [2nd Edition]

Stars: ✭ 307 (+648.78%)

Mutual labels: spark, apache-spark

aut

The Archives Unleashed Toolkit is an open-source toolkit for analyzing web archives.

Stars: ✭ 111 (+170.73%)

Mutual labels: spark, apache-spark

Sparkmeasure

This is the development repository of SparkMeasure, a tool for performance troubleshooting of Apache Spark workloads. It simplifies the collection and analysis of Spark task metrics data.

Stars: ✭ 368 (+797.56%)

Mutual labels: spark, apache-spark

Data Accelerator

Data Accelerator for Apache Spark simplifies onboarding to Streaming of Big Data. It offers a rich, easy to use experience to help with creation, editing and management of Spark jobs on Azure HDInsights or Databricks while enabling the full power of the Spark engine.

Stars: ✭ 247 (+502.44%)

Mutual labels: spark, apache-spark

spark-gradle-template

Apache Spark in your IDE with gradle

Stars: ✭ 39 (-4.88%)

Mutual labels: spark, apache-spark

Sparkle

Haskell on Apache Spark.

Stars: ✭ 419 (+921.95%)

Mutual labels: spark, apache-spark

Mobius

C# and F# language binding and extensions to Apache Spark

Stars: ✭ 929 (+2165.85%)

Mutual labels: spark, apache-spark

View All Similar Projects ➔

spark-examples

Content

To run the Java example go to the project folder and execute maven test command. Java 8 or above is required.

first-example: Performs a simple word count task. Spark, Maven, Java.
streaming-twitter-custom-receiver: A custom receiver to collect Twitter messages streams. Update resources/twitter4j.properties with your credentials to use it. Spark streaming, Maven, Java, Kryo serializer, Twitter custom receiver.

More information

For more tutorials and examples about Apache Spark visit http://www.robertomarchetto.com

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].

Stars: ✭ 41

Visit Git Page 🔗Visit User Page 🔗Visit Issues Page (3) 🔗