1499 Open source projects that are alternatives of or similar to incubator-linkis

🚚 Agile Data Preparation Workflows made easy with dask, cudf, dask_cudf and pyspark

Cookbook to install Hadoop 2.0+ using Chef

Examples for Deep Learning/Feature Store/Spark/Flink/Hive/Kafka jobs and Jupyter notebooks on Hops

My presentation at ODSC India 2018 about Deep Learning with Apache Spark

Simple and Distributed Machine Learning

Open-source distribute workflow schedule tools, also support streaming task.

🐍 Quick reference guide to common patterns & functions in PySpark.

pyspark🍒🥭 is delicious，just eat it!😋😋

Unified SQL Analytics Engine Based on SparkSQL

基于Docker构建的Hadoop开发测试环境，包含Hadoop，Hive，HBase，Spark

TiDB connectors for Flink/Hive/Presto

Liquibase extension to add Impala Database support

The Hadoop ETL UDFs are the main way to load data from Hadoop into EXASOL

SQL backend to dplyr for Impala

Hive JDBC "uber" or "standalone" jar based on the latest Apache Hive version

Apache Drill is a distributed MPP query layer for self describing data

No description or website provided.

A library that provides useful extensions to Apache Spark and PySpark.

The Archives Unleashed Toolkit is an open-source toolkit for analyzing web archives.

Basin is a visual programming editor for building Spark and PySpark pipelines. Easily build, debug, and deploy complex ETL pipelines from your browser

Compile-time Language Integrated Queries for Scala

80+ DevOps & Data CLI Tools - AWS, GCP, GCF Python Cloud Function, Log Anonymizer, Spark, Hadoop, HBase, Hive, Impala, Linux, Docker, Spark Data Converters & Validators (Avro/Parquet/JSON/CSV/INI/XML/YAML), Travis CI, AWS CloudFormation, Elasticsearch, Solr etc.

Training models with Apache Spark, PySpark for Titanic Kaggle competition

Fundamentals of Spark with Python (using PySpark), code examples

同步Hive数据仓库数据到Elasticsearch的小工具

An alternative to the "hive standalone" jar for connecting Java applications to Apache Hive via JDBC

Some class materials for a data processing course using PySpark

Alluxio Python client - Access Any Data Source with Python

Mapping rows from a SQL database to POJOs in its simplest form

❄️ 🐳 Awesome tools and libs for AI, Deep Learning, Machine Learning, Computer Vision, Data Science, Data Analytics and Cognitive Computing that are baked in the oven to be Native on Kubernetes and Docker with Python, R, Scala, Java, C#, Go, Julia, C++ etc

A game engine to learn about game engine development

MonoGame.Forms is the easiest way of integrating a MonoGame render window into your Windows Forms project. It should make your life much easier, when you want to create your own editor environment.

OpenAM is an open access management solution that includes Authentication, SSO, Authorization, Federation, Entitlements and Web Services Security.

Sparkline BI Accelerator provides fast ad-hoc query capability over Logical Cubes. This has been folded into our SNAP Platform(http://bit.ly/2oBJSpP) an Integrated BI platform on Apache Spark.

An Azure Databricks workshop leveraging the New York Taxi and Limousine Commission Trip Records dataset

Docker image for Apache Hive Metastore

Performance engineering for the rest of us.

DTC is a high performance Distributed Table Cache system designed by JD.com that offering hotspot data cache for databases in order to reduce pressure of database and improve QPS.

Extendable calculator for the 21st Century ⚡

Mutation testing framework and code coverage for Hive SQL

Elara DB is an easy to use, lightweight key-value database that can also be used as a fast in-memory cache. Manipulate data structures in-memory, encrypt database files and export data. 🎯

ProjectFNF 2.0, based on Psych Engine

An extensive non-reactive Typescript framework that eases the development experience in Spark AR

PHP class for Selectel storage

spark on kubernetes

Resources for Spark AR

Code examples for my blog posts

Autoscaling for Google Cloud Dataproc

Blockchain with native storage and smart contract integration.

Universal LocalStorage for browser and Node.js.

🛠 Utilities for working with nft.storage.

Android processing and secured library for managing SharedPreferences as key-value elements efficiently and structurally.

Apache Spark Sentry Integration

Spica is a development engine to build fast & efficient applications.

Fast Data Cluster (Apache Cassandra, Kafka, Spark, Flink, YARN and HDFS with Vagrant and VirtualBox)

Implementation of Fellegi-Sunter's canonical model of record linkage in Apache Spark, including EM algorithm to estimate parameters

Auto-resize PersistentVolumeClaim objects based on Prometheus metrics

Spark functions to run popular phonetic and string matching algorithms

A Jupyter notebook using some standard techniques for data science and data engineering to analyze data for the 2017 flooding in Houston, TX.

A cross-platform, realtime physics engine for all .NET apps.