HyperspaceAn open source indexing subsystem that brings index-based query acceleration to Apache Spark™ and big data workloads.
Stars: ✭ 246 (+1540%)
awesome-AI-kubernetes❄️ 🐳 Awesome tools and libs for AI, Deep Learning, Machine Learning, Computer Vision, Data Science, Data Analytics and Cognitive Computing that are baked in the oven to be Native on Kubernetes and Docker with Python, R, Scala, Java, C#, Go, Julia, C++ etc
Stars: ✭ 95 (+533.33%)
SparkrdmaRDMA accelerated, high-performance, scalable and efficient ShuffleManager plugin for Apache Spark
Stars: ✭ 215 (+1333.33%)
Ruby SparkRuby wrapper for Apache Spark
Stars: ✭ 221 (+1373.33%)
sparkar-voltsAn extensive non-reactive Typescript framework that eases the development experience in Spark AR
Stars: ✭ 15 (+0%)
visualize-data-with-pythonA Jupyter notebook using some standard techniques for data science and data engineering to analyze data for the 2017 flooding in Houston, TX.
Stars: ✭ 60 (+300%)
Search Ads Web ServiceOnline search advertisement platform & Realtime Campaign Monitoring [Maybe Deprecated]
Stars: ✭ 30 (+100%)
Spark Fast TestsApache Spark testing helpers (dependency free & works with Scalatest, uTest, and MUnit)
Stars: ✭ 249 (+1560%)
docker-sparkApache Spark docker container image (Standalone mode)
Stars: ✭ 34 (+126.67%)
DparkPython clone of Spark, a MapReduce alike framework in Python
Stars: ✭ 2,668 (+17686.67%)
openverse-catalogIdentifies and collects data on cc-licensed content across web crawl data and public apis.
Stars: ✭ 27 (+80%)
Azure Event Hubs☁️ Cloud-scale telemetry ingestion from any stream of data with Azure Event Hubs
Stars: ✭ 233 (+1453.33%)
Spark-PMoFSpark Shuffle Optimization with RDMA+AEP
Stars: ✭ 28 (+86.67%)
ODSC India 2018My presentation at ODSC India 2018 about Deep Learning with Apache Spark
Stars: ✭ 26 (+73.33%)
Spark ExcelA Spark plugin for reading Excel files via Apache POI
Stars: ✭ 216 (+1340%)
Example SparkSpark, Spark Streaming and Spark SQL unit testing strategies
Stars: ✭ 205 (+1266.67%)
experimentsCode examples for my blog posts
Stars: ✭ 21 (+40%)
spark-stringmetricSpark functions to run popular phonetic and string matching algorithms
Stars: ✭ 51 (+240%)
MmlsparkSimple and Distributed Machine Learning
Stars: ✭ 2,899 (+19226.67%)
shamashAutoscaling for Google Cloud Dataproc
Stars: ✭ 31 (+106.67%)
KoalasKoalas: pandas API on Apache Spark
Stars: ✭ 3,044 (+20193.33%)
kafka-compose🎼 Docker compose files for various kafka stacks
Stars: ✭ 32 (+113.33%)
Every Single Day I TldrA daily digest of the articles or videos I've found interesting, that I want to share with you.
Stars: ✭ 249 (+1560%)
yuzhouwanCode Library for My Blog
Stars: ✭ 39 (+160%)
Data AcceleratorData Accelerator for Apache Spark simplifies onboarding to Streaming of Big Data. It offers a rich, easy to use experience to help with creation, editing and management of Spark jobs on Azure HDInsights or Databricks while enabling the full power of the Spark engine.
Stars: ✭ 247 (+1546.67%)
frovedisFramework of vectorized and distributed data analytics
Stars: ✭ 59 (+293.33%)
Neo4j Spark ConnectorNeo4j Connector for Apache Spark, which provides bi-directional read/write access to Neo4j from Spark, using the Spark DataSource APIs
Stars: ✭ 245 (+1533.33%)
spark-utillow-level helpers for Apache Spark libraries and tests
Stars: ✭ 16 (+6.67%)
RecommendationsystemBook recommender system using collaborative filtering based on Spark
Stars: ✭ 244 (+1526.67%)
sentry-sparkApache Spark Sentry Integration
Stars: ✭ 14 (-6.67%)
Hadoop Docker基于Docker构建的Hadoop开发测试环境,包含Hadoop,Hive,HBase,Spark
Stars: ✭ 238 (+1486.67%)
tpch-sparkTPC-H queries in Apache Spark SQL using native DataFrames API
Stars: ✭ 63 (+320%)
MydatascienceportfolioApplying Data Science and Machine Learning to Solve Real World Business Problems
Stars: ✭ 227 (+1413.33%)
spark-druid-olapSparkline BI Accelerator provides fast ad-hoc query capability over Logical Cubes. This has been folded into our SNAP Platform(http://bit.ly/2oBJSpP) an Integrated BI platform on Apache Spark.
Stars: ✭ 286 (+1806.67%)
Spark WorkshopApache Spark™ and Scala Workshops
Stars: ✭ 224 (+1393.33%)
spark-acidACID Data Source for Apache Spark based on Hive ACID
Stars: ✭ 91 (+506.67%)
swordfishOpen-source distribute workflow schedule tools, also support streaming task.
Stars: ✭ 35 (+133.33%)
GimelBig Data Processing Framework - Unified Data API or SQL on Any Storage
Stars: ✭ 216 (+1340%)
Spark-ArResources for Spark AR
Stars: ✭ 43 (+186.67%)
Spark Knnk-Nearest Neighbors algorithm on Spark
Stars: ✭ 205 (+1266.67%)
spark-word2vecA parallel implementation of word2vec based on Spark
Stars: ✭ 24 (+60%)
fastdata-clusterFast Data Cluster (Apache Cassandra, Kafka, Spark, Flink, YARN and HDFS with Vagrant and VirtualBox)
Stars: ✭ 20 (+33.33%)
autThe Archives Unleashed Toolkit is an open-source toolkit for analyzing web archives.
Stars: ✭ 111 (+640%)
incubator-linkisLinkis helps easily connect to various back-end computation/storage engines(Spark, Python, TiDB...), exposes various interfaces(REST, JDBC, Java ...), with multi-tenancy, high performance, and resource control.
Stars: ✭ 2,459 (+16293.33%)
leaflet heatmap简单的可视化湖州通话数据 假设数据量很大,没法用浏览器直接绘制热力图,把绘制热力图这一步骤放到线下计算分析。使用Apache Spark并行计算数据之后,再使用Apache Spark绘制热力图,然后用leafletjs加载OpenStreetMap图层和热力图图层,以达到良好的交互效果。现在使用Apache Spark实现绘制,可能是Apache Spark不擅长这方面的计算或者是我没有设计好算法,并行计算的速度比不上单机计算。Apache Spark绘制热力图和计算代码在这 https://github.com/yuanzhaokang/ParallelizeHeatmap.git .
Stars: ✭ 13 (-13.33%)
splinkImplementation of Fellegi-Sunter's canonical model of record linkage in Apache Spark, including EM algorithm to estimate parameters
Stars: ✭ 181 (+1106.67%)