MobiusC# and F# language binding and extensions to Apache Spark
Stars: ✭ 929 (+466.46%)
Agile data code 2Code for Agile Data Science 2.0, O'Reilly 2017, Second Edition
Stars: ✭ 413 (+151.83%)
Data AcceleratorData Accelerator for Apache Spark simplifies onboarding to Streaming of Big Data. It offers a rich, easy to use experience to help with creation, editing and management of Spark jobs on Azure HDInsights or Databricks while enabling the full power of the Spark engine.
Stars: ✭ 247 (+50.61%)
CdapAn open source framework for building data analytic applications.
Stars: ✭ 509 (+210.37%)
ImpyImpy is a Python3 library with features that help you in your computer vision tasks.
Stars: ✭ 109 (-33.54%)
Spark WorkshopApache Spark™ and Scala Workshops
Stars: ✭ 224 (+36.59%)
Learningsparkv2This is the github repo for Learning Spark: Lightning-Fast Data Analytics [2nd Edition]
Stars: ✭ 307 (+87.2%)
Coolplayspark酷玩 Spark: Spark 源代码解析、Spark 类库等
Stars: ✭ 3,318 (+1923.17%)
Spark NkpNatural Korean Processor for Apache Spark
Stars: ✭ 50 (-69.51%)
Awesome PulsarA curated list of Pulsar tools, integrations and resources.
Stars: ✭ 57 (-65.24%)
SparklyrR interface for Apache Spark
Stars: ✭ 775 (+372.56%)
CuesheetA framework for writing Spark 2.x applications in a pretty way
Stars: ✭ 86 (-47.56%)
SparkrdmaRDMA accelerated, high-performance, scalable and efficient ShuffleManager plugin for Apache Spark
Stars: ✭ 215 (+31.1%)
Openml RR package to interface with OpenML
Stars: ✭ 81 (-50.61%)
Spark Jupyter AwsA guide on how to set up Jupyter with Pyspark painlessly on AWS EC2 clusters, with S3 I/O support
Stars: ✭ 259 (+57.93%)
Data Setstate driven all in one data process for data visualization
Stars: ✭ 191 (+16.46%)
TedsdsApache Spark - Turbofan Engine Degradation Simulation Data Set example in Apache Spark
Stars: ✭ 14 (-91.46%)
Spark FlamegraphEasy CPU Profiling for Apache Spark applications
Stars: ✭ 30 (-81.71%)
Spark On K8s OperatorKubernetes operator for managing the lifecycle of Apache Spark applications on Kubernetes.
Stars: ✭ 1,780 (+985.37%)
SplashSplash, a flexible Spark shuffle manager that supports user-defined storage backends for shuffle data storage and exchange
Stars: ✭ 105 (-35.98%)
Parquet IndexSpark SQL index for Parquet tables
Stars: ✭ 109 (-33.54%)
Pulsar SparkWhen Apache Pulsar meets Apache Spark
Stars: ✭ 55 (-66.46%)
Spark TdaSparkTDA is a package for Apache Spark providing Topological Data Analysis Functionalities.
Stars: ✭ 45 (-72.56%)
Spark StatesCustom state store providers for Apache Spark
Stars: ✭ 83 (-49.39%)
MmlsparkSimple and Distributed Machine Learning
Stars: ✭ 2,899 (+1667.68%)
Goodreads etl pipelineAn end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.
Stars: ✭ 793 (+383.54%)
autThe Archives Unleashed Toolkit is an open-source toolkit for analyzing web archives.
Stars: ✭ 111 (-32.32%)
leaflet heatmap简单的可视化湖州通话数据 假设数据量很大,没法用浏览器直接绘制热力图,把绘制热力图这一步骤放到线下计算分析。使用Apache Spark并行计算数据之后,再使用Apache Spark绘制热力图,然后用leafletjs加载OpenStreetMap图层和热力图图层,以达到良好的交互效果。现在使用Apache Spark实现绘制,可能是Apache Spark不擅长这方面的计算或者是我没有设计好算法,并行计算的速度比不上单机计算。Apache Spark绘制热力图和计算代码在这 https://github.com/yuanzhaokang/ParallelizeHeatmap.git .
Stars: ✭ 13 (-92.07%)
Spark NotebookInteractive and Reactive Data Science using Scala and Spark.
Stars: ✭ 3,081 (+1778.66%)
SparkmeasureThis is the development repository of SparkMeasure, a tool for performance troubleshooting of Apache Spark workloads. It simplifies the collection and analysis of Spark task metrics data.
Stars: ✭ 368 (+124.39%)
WirbelsturmWirbelsturm is a Vagrant and Puppet based tool to perform 1-click local and remote deployments, with a focus on big data tech like Kafka.
Stars: ✭ 332 (+102.44%)
SparkleHaskell on Apache Spark.
Stars: ✭ 419 (+155.49%)
Spark With PythonFundamentals of Spark with Python (using PySpark), code examples
Stars: ✭ 150 (-8.54%)
Live log analyzer sparkSpark Application for analysis of Apache Access logs and detect anamolies! Along with Medium Article.
Stars: ✭ 14 (-91.46%)
Kafka Storm StarterCode examples that show to integrate Apache Kafka 0.8+ with Apache Storm 0.9+ and Apache Spark Streaming 1.1+, while using Apache Avro as the data serialization format.
Stars: ✭ 728 (+343.9%)
SetlA simple Spark-powered ETL framework that just works 🍺
Stars: ✭ 79 (-51.83%)
Spark.NET for Apache® Spark™ makes Apache Spark™ easily accessible to .NET developers.
Stars: ✭ 1,721 (+949.39%)
Azure Event Hubs SparkEnabling Continuous Data Processing with Apache Spark and Azure Event Hubs
Stars: ✭ 140 (-14.63%)
Vue Uwebvue 友盟统计埋点插件
Stars: ✭ 154 (-6.1%)
SparkmonitorMonitor Apache Spark from Jupyter Notebook
Stars: ✭ 154 (-6.1%)
Vue Info CardSimple and beautiful card component with an elegant spark line, for VueJS.
Stars: ✭ 159 (-3.05%)
Omr DatasetsCollection of datasets used for Optical Music Recognition
Stars: ✭ 158 (-3.66%)
Stability Selectionscikit-learn compatible implementation of stability selection.
Stars: ✭ 155 (-5.49%)
EvoskeletonOfficial project website for the CVPR 2020 paper (Oral Presentation) "Cascaded Deep Monocular 3D Human Pose Estimation With Evolutionary Training Data"
Stars: ✭ 154 (-6.1%)
Weihanli.npoiNPOI Extensions, excel/csv importer/exporter for IEnumerable<T>/DataTable, fluentapi(great flexibility)/attribute configuration
Stars: ✭ 157 (-4.27%)
Awesome BiomechanicsA curated, public list collecting resources for biomechanics and human motion: datasets, processing tools, software for simulation, educational videos, lectures, etc.
Stars: ✭ 154 (-6.1%)
QuillCompile-time Language Integrated Queries for Scala
Stars: ✭ 1,998 (+1118.29%)