456 Open source projects that are alternatives of or similar to big-data-engineering-indonesia

The Data Engineering Cookbook

Example end to end data engineering project.

📊 📋 Dashboards using YAML or JSON files

The Accelerator is a tool for fast and reproducible processing of large amounts of data.

A simple Spark-powered ETL framework that just works 🍺

Feature Store for Machine Learning

A Clojure dataframe library that runs on Spark

The server components for the AcousticBrainz project

PredictionIO Python SDK

ClickHouse® is a free analytics DBMS for big data

Data Accelerator for Apache Spark simplifies onboarding to Streaming of Big Data. It offers a rich, easy to use experience to help with creation, editing and management of Spark jobs on Azure HDInsights or Databricks while enabling the full power of the Spark engine.

A curated list of awesome dbt resources

C4E, a JVM friendly library written in Scala for both local and distributed (Spark) Clustering.

PredictionIO Recommendation Engine Template (Scala-based parallelized engine)

Apache CouchDB Packaging support files

⚡️A vue component support big amount data list with high render performance and efficient.

CSVs sliced, diced & analyzed.

Open and collaborative content from leet hackers!

A serverless architecture for orchestrating ETL jobs in arbitrarily-complex workflows using AWS Step Functions and AWS Lambda.

Less-Resilient MapReduce framework for Go

Full featured TypeScript Twitter archive reader and browser

Open-Source Web GUI for Apache Kafka Management

Python Client and Toolkit for DataFrames, Big Data, Machine Learning and ETL in Elasticsearch

A client for connecting and running DDLs on hive metastore.

Virtual list component library supporting waterfall flow based on vue

U-SQL Examples and Issue Tracking

PredictionIO Ruby SDK

YT metadata exporter

Microsoft's contributions for Spark with Apache Accumulo

Apache Phoenix Query Server

No description or website provided.

Intel(R) Extension for Scikit-learn is a seamless way to speed up your Scikit-learn application

A collection of Airflow operators, hooks, and utilities to elevate dbt to a first-class citizen of Airflow.

The metrics layer for your data. Join us at https://metriql.com/slack

Koalas: pandas API on Apache Spark

[READ-ONLY] PHP - ETL (Extract Transform Load) data processing library

An easy to use, self-service open BI reporting and BI dashboard platform.

cdp数据平台，帮助企业充分了解客户，实现千人千面的精准营销。

An open source indexing subsystem that brings index-based query acceleration to Apache Spark™ and big data workloads.

Apache Accumulo Docker

Apache Trafodion

High-scalability analytics database built on immutable merkle-trees

An advanced distributed task flow management on top of Celery

Bullet is a streaming query engine that can be plugged into any singular data stream using a Stream Processing framework like Apache Storm, Spark or Flink.

整理一些书籍 ,包含 C&C++ 、git 、Java、Keras 、Linux 、NLP 、Python 、Scala 、TensorFlow 、大数据 、推荐系统、数据库、数据挖掘 、机器学习 、深度学习 、算法等。

(Latest semester at https://github.com/kmader/Quantitative-Big-Imaging-2019) The material for the Quantitative Big Imaging course at ETHZ for the Spring Semester 2018

Bare bone examples of machine learning in TensorFlow

Apache Accumulo Testing

The Distributed Computing library for python implemented using PyCOMPSs programming model for HPC.

Big Data Processing Framework - Unified Data API or SQL on Any Storage

Soda Spark is a PySpark library that helps you with testing your data in Spark Dataframes

Mirror of Apache Tez (Incubating)

Manipulate arrays of complex data structures as easily as Numpy.

RDMA accelerated, high-performance, scalable and efficient ShuffleManager plugin for Apache Spark

Blog post on ETL pipelines with Airflow

Helical Insight software is world’s first Open Source Business Intelligence framework which helps you to make sense out of your data and make well informed decisions.

Apache Calcite

An R package for large scale estimation with stochastic gradient descent

XML/Document DB on top of distributed cache

PredictionIO Python SDK