shamashAutoscaling for Google Cloud Dataproc
Stars: ✭ 31 (-59.74%)
awesome-AI-kubernetes❄️ 🐳 Awesome tools and libs for AI, Deep Learning, Machine Learning, Computer Vision, Data Science, Data Analytics and Cognitive Computing that are baked in the oven to be Native on Kubernetes and Docker with Python, R, Scala, Java, C#, Go, Julia, C++ etc
Stars: ✭ 95 (+23.38%)
spark-demosCollection of different demo applications using Apache Spark
Stars: ✭ 15 (-80.52%)
spark-acidACID Data Source for Apache Spark based on Hive ACID
Stars: ✭ 91 (+18.18%)
splinkImplementation of Fellegi-Sunter's canonical model of record linkage in Apache Spark, including EM algorithm to estimate parameters
Stars: ✭ 181 (+135.06%)
bigdata-funA complete (distributed) BigData stack, running in containers
Stars: ✭ 14 (-81.82%)
spark-utillow-level helpers for Apache Spark libraries and tests
Stars: ✭ 16 (-79.22%)
bigkubeMinikube for big data with Scala and Spark
Stars: ✭ 16 (-79.22%)
sparkar-voltsAn extensive non-reactive Typescript framework that eases the development experience in Spark AR
Stars: ✭ 15 (-80.52%)
frovedisFramework of vectorized and distributed data analytics
Stars: ✭ 59 (-23.38%)
sentry-sparkApache Spark Sentry Integration
Stars: ✭ 14 (-81.82%)
go-giter8A simplified golang port of giter8
Stars: ✭ 22 (-71.43%)
trembitaModel complex data transformation pipelines easily
Stars: ✭ 44 (-42.86%)
spark-word2vecA parallel implementation of word2vec based on Spark
Stars: ✭ 24 (-68.83%)
spark-data-sourcesDeveloping Spark External Data Sources using the V2 API
Stars: ✭ 36 (-53.25%)
yuzhouwanCode Library for My Blog
Stars: ✭ 39 (-49.35%)
smolderHL7 Apache Spark Datasource
Stars: ✭ 33 (-57.14%)
daf-kyloKylo integration with PDND (previously DAF).
Stars: ✭ 20 (-74.03%)
ODSC India 2018My presentation at ODSC India 2018 about Deep Learning with Apache Spark
Stars: ✭ 26 (-66.23%)
tpch-sparkTPC-H queries in Apache Spark SQL using native DataFrames API
Stars: ✭ 63 (-18.18%)
experimentsCode examples for my blog posts
Stars: ✭ 21 (-72.73%)
Covid19TrackerA Robinhood style COVID-19 🦠 Android tracking app for the US. Open source and built with Kotlin.
Stars: ✭ 65 (-15.58%)
visualize-data-with-pythonA Jupyter notebook using some standard techniques for data science and data engineering to analyze data for the 2017 flooding in Houston, TX.
Stars: ✭ 60 (-22.08%)
docker-sparkApache Spark docker container image (Standalone mode)
Stars: ✭ 34 (-55.84%)
KoalasKoalas: pandas API on Apache Spark
Stars: ✭ 3,044 (+3853.25%)
spark-extensionA library that provides useful extensions to Apache Spark and PySpark.
Stars: ✭ 25 (-67.53%)
basinBasin is a visual programming editor for building Spark and PySpark pipelines. Easily build, debug, and deploy complex ETL pipelines from your browser
Stars: ✭ 25 (-67.53%)
Search Ads Web ServiceOnline search advertisement platform & Realtime Campaign Monitoring [Maybe Deprecated]
Stars: ✭ 30 (-61.04%)
CasperA compiler for automatically re-targeting sequential Java code to Apache Spark.
Stars: ✭ 45 (-41.56%)
prostoProsto is a data processing toolkit radically changing how data is processed by heavily relying on functions and operations with functions - an alternative to map-reduce and join-groupby
Stars: ✭ 54 (-29.87%)
openverse-catalogIdentifies and collects data on cc-licensed content across web crawl data and public apis.
Stars: ✭ 27 (-64.94%)
visionsType System for Data Analysis in Python
Stars: ✭ 136 (+76.62%)
spark-druid-olapSparkline BI Accelerator provides fast ad-hoc query capability over Logical Cubes. This has been folded into our SNAP Platform(http://bit.ly/2oBJSpP) an Integrated BI platform on Apache Spark.
Stars: ✭ 286 (+271.43%)
autThe Archives Unleashed Toolkit is an open-source toolkit for analyzing web archives.
Stars: ✭ 111 (+44.16%)
swordfishOpen-source distribute workflow schedule tools, also support streaming task.
Stars: ✭ 35 (-54.55%)
confluent-spark-avroSpark UDFs to deserialize Avro messages with schemas stored in Schema Registry.
Stars: ✭ 18 (-76.62%)
Spark-ArResources for Spark AR
Stars: ✭ 43 (-44.16%)
incubator-linkisLinkis helps easily connect to various back-end computation/storage engines(Spark, Python, TiDB...), exposes various interfaces(REST, JDBC, Java ...), with multi-tenancy, high performance, and resource control.
Stars: ✭ 2,459 (+3093.51%)
fastdata-clusterFast Data Cluster (Apache Cassandra, Kafka, Spark, Flink, YARN and HDFS with Vagrant and VirtualBox)
Stars: ✭ 20 (-74.03%)
dllibdllib is a distributed deep learning library running on Apache Spark
Stars: ✭ 32 (-58.44%)
spark-stringmetricSpark functions to run popular phonetic and string matching algorithms
Stars: ✭ 51 (-33.77%)
Spark-PMoFSpark Shuffle Optimization with RDMA+AEP
Stars: ✭ 28 (-63.64%)
blogblog entries
Stars: ✭ 39 (-49.35%)
leaflet heatmap简单的可视化湖州通话数据 假设数据量很大,没法用浏览器直接绘制热力图,把绘制热力图这一步骤放到线下计算分析。使用Apache Spark并行计算数据之后,再使用Apache Spark绘制热力图,然后用leafletjs加载OpenStreetMap图层和热力图图层,以达到良好的交互效果。现在使用Apache Spark实现绘制,可能是Apache Spark不擅长这方面的计算或者是我没有设计好算法,并行计算的速度比不上单机计算。Apache Spark绘制热力图和计算代码在这 https://github.com/yuanzhaokang/ParallelizeHeatmap.git .
Stars: ✭ 13 (-83.12%)
Book本项目收藏这些年来看过或者听过的一些不错的书籍,在整理文件时看见这些,发现删掉有点可惜,放着又太浪费空间,本着分享的原则,就把它们共享出来,一方面给需要的读者提供这些书籍,另一方面也是一种像知识库的积累吧
Stars: ✭ 47 (-38.96%)
spark-http-streamspark structured streaming via HTTP communication
Stars: ✭ 17 (-77.92%)
SparkV🤖⚡ | The most POWERFUL multipurpose chat/meme bot that will boost the activity in your server.
Stars: ✭ 24 (-68.83%)
kafka-compose🎼 Docker compose files for various kafka stacks
Stars: ✭ 32 (-58.44%)