autThe Archives Unleashed Toolkit is an open-source toolkit for analyzing web archives.
Stars: ✭ 111 (+136.17%)
spark-recordsBulletproof Apache Spark jobs with fast root cause analysis of failures.
Stars: ✭ 67 (+42.55%)
HydrographA visual ETL development and debugging tool for big data
Stars: ✭ 144 (+206.38%)
SparkrdmaRDMA accelerated, high-performance, scalable and efficient ShuffleManager plugin for Apache Spark
Stars: ✭ 215 (+357.45%)
Spark With PythonFundamentals of Spark with Python (using PySpark), code examples
Stars: ✭ 150 (+219.15%)
ParquetviewerSimple windows desktop application for viewing & querying Apache Parquet files
Stars: ✭ 145 (+208.51%)
datalake-etl-pipelineSimplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validation, Column extensions, SQL functions, and DataFrame transformations
Stars: ✭ 39 (-17.02%)
SynapseMLSimple and Distributed Machine Learning
Stars: ✭ 3,355 (+7038.3%)
Data AcceleratorData Accelerator for Apache Spark simplifies onboarding to Streaming of Big Data. It offers a rich, easy to use experience to help with creation, editing and management of Spark jobs on Azure HDInsights or Databricks while enabling the full power of the Spark engine.
Stars: ✭ 247 (+425.53%)
MistServerless proxy for Spark cluster
Stars: ✭ 309 (+557.45%)
mmtf-workshop-2018Structural Bioinformatics Training Workshop & Hackathon 2018
Stars: ✭ 50 (+6.38%)
gan deeplearning4jAutomatic feature engineering using Generative Adversarial Networks using Deeplearning4j and Apache Spark.
Stars: ✭ 19 (-59.57%)
Griffon VmGriffon Data Science Virtual Machine
Stars: ✭ 128 (+172.34%)
leaflet heatmap简单的可视化湖州通话数据 假设数据量很大,没法用浏览器直接绘制热力图,把绘制热力图这一步骤放到线下计算分析。使用Apache Spark并行计算数据之后,再使用Apache Spark绘制热力图,然后用leafletjs加载OpenStreetMap图层和热力图图层,以达到良好的交互效果。现在使用Apache Spark实现绘制,可能是Apache Spark不擅长这方面的计算或者是我没有设计好算法,并行计算的速度比不上单机计算。Apache Spark绘制热力图和计算代码在这 https://github.com/yuanzhaokang/ParallelizeHeatmap.git .
Stars: ✭ 13 (-72.34%)
MorpheusMorpheus brings the leading graph query language, Cypher, onto the leading distributed processing platform, Spark.
Stars: ✭ 303 (+544.68%)
sparkucxA high-performance, scalable and efficient ShuffleManager plugin for Apache Spark, utilizing UCX communication layer
Stars: ✭ 32 (-31.91%)
Parquet Dotnet🏐 Apache Parquet for modern .NET
Stars: ✭ 276 (+487.23%)
mmtf-sparkMethods for the parallel and distributed analysis and mining of the Protein Data Bank using MMTF and Apache Spark.
Stars: ✭ 20 (-57.45%)
awesome-toolscurated list of awesome tools and libraries for specific domains
Stars: ✭ 31 (-34.04%)
SGDLibraryMATLAB/Octave library for stochastic optimization algorithms: Version 1.0.20
Stars: ✭ 165 (+251.06%)
GDLibraryMatlab library for gradient descent algorithms: Version 1.0.1
Stars: ✭ 50 (+6.38%)
MmlsparkSimple and Distributed Machine Learning
Stars: ✭ 2,899 (+6068.09%)
pyspark-cheatsheetPySpark Cheat Sheet - example code to help you learn PySpark and develop apps faster
Stars: ✭ 115 (+144.68%)
Bigdata PlaygroundA complete example of a big data application using : Kubernetes (kops/aws), Apache Spark SQL/Streaming/MLib, Apache Flink, Scala, Python, Apache Kafka, Apache Hbase, Apache Parquet, Apache Avro, Apache Storm, Twitter Api, MongoDB, NodeJS, Angular, GraphQL
Stars: ✭ 177 (+276.6%)
DvidDistributed, Versioned, Image-oriented Dataservice
Stars: ✭ 174 (+270.21%)
Lite Virtual ListVirtual list component library supporting waterfall flow based on vue
Stars: ✭ 223 (+374.47%)
KeyviKeyvi - a key value index that powers Cliqz search engine. It is an in-memory FST-based data structure highly optimized for size and lookup performance.
Stars: ✭ 171 (+263.83%)
Attic PredictionioPredictionIO, a machine learning server for developers and ML engineers.
Stars: ✭ 12,522 (+26542.55%)
NakedtensorBare bone examples of machine learning in TensorFlow
Stars: ✭ 2,443 (+5097.87%)
GeopysparkGeoTrellis for PySpark
Stars: ✭ 167 (+255.32%)
KeyviKeyvi - the key value index. It is an in-memory FST-based data structure highly optimized for size and lookup performance.
Stars: ✭ 161 (+242.55%)
UsqlU-SQL Examples and Issue Tracking
Stars: ✭ 221 (+370.21%)
FluoApache Fluo
Stars: ✭ 159 (+238.3%)
PrestoThe official home of the Presto distributed SQL query engine for big data
Stars: ✭ 12,957 (+27468.09%)
ClickhouseClickHouse® is a free analytics DBMS for big data
Stars: ✭ 21,089 (+44770.21%)
HyperspaceAn open source indexing subsystem that brings index-based query acceleration to Apache Spark™ and big data workloads.
Stars: ✭ 246 (+423.4%)
GimelBig Data Processing Framework - Unified Data API or SQL on Any Storage
Stars: ✭ 216 (+359.57%)
GeniA Clojure dataframe library that runs on Spark
Stars: ✭ 152 (+223.4%)
Spark.jlJulia binding for Apache Spark
Stars: ✭ 153 (+225.53%)
Awkward 0.xManipulate arrays of complex data structures as easily as Numpy.
Stars: ✭ 216 (+359.57%)
DatasciencevmTools and Docs on the Azure Data Science Virtual Machine (http://aka.ms/dsvm)
Stars: ✭ 153 (+225.53%)
Aws Etl OrchestratorA serverless architecture for orchestrating ETL jobs in arbitrarily-complex workflows using AWS Step Functions and AWS Lambda.
Stars: ✭ 245 (+421.28%)
FiliEasily make RESTful web services for time series reporting with Big Data analytics engines like Druid and SQL Databases.
Stars: ✭ 151 (+221.28%)
HelicalinsightHelical Insight software is world’s first Open Source Business Intelligence framework which helps you to make sense out of your data and make well informed decisions.
Stars: ✭ 214 (+355.32%)
100daysofmlcodeMy journey to learn and grow in the domain of Machine Learning and Artificial Intelligence by performing the #100DaysofMLCode Challenge.
Stars: ✭ 146 (+210.64%)
KoalasKoalas: pandas API on Apache Spark
Stars: ✭ 3,044 (+6376.6%)
TrafodionApache Trafodion
Stars: ✭ 242 (+414.89%)
CalciteApache Calcite
Stars: ✭ 2,816 (+5891.49%)
MetamodelMirror of Apache Metamodel
Stars: ✭ 143 (+204.26%)
Belajarpython.comOpen Source Indonesian Python Programming Tutorial Site
Stars: ✭ 141 (+200%)
Kafka UiOpen-Source Web GUI for Apache Kafka Management
Stars: ✭ 230 (+389.36%)
Couchdb DockerSemi-official Apache CouchDB Docker images
Stars: ✭ 194 (+312.77%)
Eel SdkBig Data Toolkit for the JVM
Stars: ✭ 140 (+197.87%)