470 Open source projects that are alternatives of or similar to awesome-tools

Bulletproof Apache Spark jobs with fast root cause analysis of failures.

Structural Bioinformatics Training Workshop & Hackathon 2018

PySpark Cheat Sheet - example code to help you learn PySpark and develop apps faster

Serverless proxy for Spark cluster

RDMA accelerated, high-performance, scalable and efficient ShuffleManager plugin for Apache Spark

Methods for the parallel and distributed analysis and mining of the Protein Data Bank using MMTF and Apache Spark.

🏐 Apache Parquet for modern .NET

Apache Spark Course Material

A high-performance, scalable and efficient ShuffleManager plugin for Apache Spark, utilizing UCX communication layer

The Archives Unleashed Toolkit is an open-source toolkit for analyzing web archives.

Fundamentals of Spark with Python (using PySpark), code examples

A visual ETL development and debugging tool for big data

Griffon Data Science Virtual Machine

No description or website provided.

Project for James' Apache Spark with Scala course

Apache Spark on AWS Lambda

Data Accelerator for Apache Spark simplifies onboarding to Streaming of Big Data. It offers a rich, easy to use experience to help with creation, editing and management of Spark jobs on Azure HDInsights or Databricks while enabling the full power of the Spark engine.

Morpheus brings the leading graph query language, Cypher, onto the leading distributed processing platform, Spark.

Simple and Distributed Machine Learning

Automatic feature engineering using Generative Adversarial Networks using Deeplearning4j and Apache Spark.

Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validation, Column extensions, SQL functions, and DataFrame transformations

简单的可视化湖州通话数据 假设数据量很大，没法用浏览器直接绘制热力图，把绘制热力图这一步骤放到线下计算分析。使用Apache Spark并行计算数据之后，再使用Apache Spark绘制热力图，然后用leafletjs加载OpenStreetMap图层和热力图图层，以达到良好的交互效果。现在使用Apache Spark实现绘制，可能是Apache Spark不擅长这方面的计算或者是我没有设计好算法，并行计算的速度比不上单机计算。Apache Spark绘制热力图和计算代码在这 https://github.com/yuanzhaokang/ParallelizeHeatmap.git .

Simple and Distributed Machine Learning

Simple windows desktop application for viewing & querying Apache Parquet files

A complete example of a big data application using : Kubernetes (kops/aws), Apache Spark SQL/Streaming/MLib, Apache Flink, Scala, Python, Apache Kafka, Apache Hbase, Apache Parquet, Apache Avro, Apache Storm, Twitter Api, MongoDB, NodeJS, Angular, GraphQL

A connector for Apache Spark to access Exasol

PredictionIO Ruby SDK

YT metadata exporter

The server components for the AcousticBrainz project

Microsoft's contributions for Spark with Apache Accumulo

Sentiment Analysis of a Twitter Topic with Spark Structured Streaming

C4E, a JVM friendly library written in Scala for both local and distributed (Spark) Clustering.

PredictionIO Recommendation Engine Template (Scala-based parallelized engine)

ClickHouse® is a free analytics DBMS for big data

Open and collaborative content from leet hackers!

Repository for integration with Apache Kafka

Intel(R) Extension for Scikit-learn is a seamless way to speed up your Scikit-learn application

Koalas: pandas API on Apache Spark

⚡️A vue component support big amount data list with high render performance and efficient.

PredictionIO Python SDK

An easy to use, self-service open BI reporting and BI dashboard platform.

Apache CouchDB Packaging support files

Apache Accumulo Docker

An open source indexing subsystem that brings index-based query acceleration to Apache Spark™ and big data workloads.

A serverless architecture for orchestrating ETL jobs in arbitrarily-complex workflows using AWS Step Functions and AWS Lambda.

Astronomy Broker based on Apache Spark

Apache Trafodion

Open-Source Web GUI for Apache Kafka Management

Java 程序员进阶学习的思维导图

The Distributed Computing library for python implemented using PyCOMPSs programming model for HPC.

Real-world Spark pipelines examples

Full featured TypeScript Twitter archive reader and browser

An advanced distributed task flow management on top of Celery

Python Client and Toolkit for DataFrames, Big Data, Machine Learning and ETL in Elasticsearch

Bullet is a streaming query engine that can be plugged into any singular data stream using a Stream Processing framework like Apache Storm, Spark or Flink.

整理一些书籍 ,包含 C&C++ 、git 、Java、Keras 、Linux 、NLP 、Python 、Scala 、TensorFlow 、大数据 、推荐系统、数据库、数据挖掘 、机器学习 、深度学习 、算法等。

Virtual list component library supporting waterfall flow based on vue

cdp数据平台，帮助企业充分了解客户，实现千人千面的精准营销。

Apache Accumulo Testing

Bare bone examples of machine learning in TensorFlow