1658 Open source projects that are alternatives of or similar to Scriptis

Linkis helps easily connect to various back-end computation/storage engines(Spark, Python, TiDB...), exposes various interfaces(REST, JDBC, Java ...), with multi-tenancy, high performance, and resource control.

Unified SQL Analytics Engine Based on SparkSQL

Kyuubi is a unified multi-tenant JDBC interface for large-scale data processing and analytics, built on top of Apache Spark

Linkis helps easily connect to various back-end computation/storage engines(Spark, Python, TiDB...), exposes various interfaces(REST, JDBC, Java ...), with multi-tenancy, high performance, and resource control.

Big Data Ecosystem Docker

A Flexible, Fast, Federated(3F) SQL Analysis Middleware for Multiple Data Sources

Fundamentals of Spark with Python (using PySpark), code examples

WeDataSphere is a financial level one-stop open-source suitcase for big data platforms. Currently the source code of Scriptis and Linkis has already been released to the open-source community. WeDataSphere, Big Data Made Easy!

DataSphereStudio is a one stop data application development& management portal, covering scenarios including data exchange, desensitization/cleansing, analysis/mining, quality measurement, visualization, and task scheduling.

Process Common Crawl data with Python and Spark

Isolation Forest on Spark

Apache Spark (PySpark) Practice on Real Data

A Spark SQL extension which provides SQL Standard Authorization for Apache Spark

Updated repository

Apache Spark Connector for Azure Cosmos DB

LearningApacheSpark

A facebook for data

Apache Spark - A unified analytics engine for large-scale data processing

Apache Spark Website

Example project implementing best practices for PySpark ETL jobs and applications.

Java library for approximate nearest neighbors search using Hierarchical Navigable Small World graphs

Simple and Distributed Machine Learning

A framework for rapid reporting API development; with out of the box support for high cardinality dimension lookups with druid.

The official home of the Presto distributed SQL query engine for big data

Open-source distribute workflow schedule tools, also support streaming task.

My presentation at ODSC India 2018 about Deep Learning with Apache Spark

ACID Data Source for Apache Spark based on Hive ACID

Hadoop Crypto Ledger - Analyzing CryptoLedgers, such as Bitcoin Blockchain, on Big Data platforms, such as Hadoop/Spark/Flink/Hive

pyspark🍒🥭 is delicious，just eat it!😋😋

DataFusion has now been donated to the Apache Arrow project

📊 Cube — Open-Source Analytics API for Building Data Apps

HandySpark - bringing pandas-like capabilities to Spark dataframes

State of the Art Natural Language Processing

🐍 Quick reference guide to common patterns & functions in PySpark.

Parquet file generator

基于Docker构建的Hadoop开发测试环境，包含Hadoop，Hive，HBase，Spark

Next generation tool for decentralized exchange and transformation of semi-structured data

Big Data Processing Framework - Unified Data API or SQL on Any Storage

Spark SQL index for Parquet tables

A PHP library for connecting to Hive or Impala over Thrift

The Archives Unleashed Toolkit is an open-source toolkit for analyzing web archives.

🎼 Docker compose files for various kafka stacks

A complete (distributed) BigData stack, running in containers

O'Reilly Book: [Data Algorithms with Spark] by Mahmoud Parsian

云计算之hadoop、hive、hue、oozie、sqoop、hbase、zookeeper环境搭建及配置文件

Multi docker container images for main Big Data Tools. (Hadoop, Spark, Kafka, HBase, Cassandra, Zookeeper, Zeppelin, Drill, Flink, Hive, Hue, Mesos, ... )

Some class materials for a data processing course using PySpark

U++ is a C++ cross-platform rapid application development framework focused on programmer's productivity. It includes a set of libraries (GUI, SQL, Network etc.), and integrated development environment (TheIDE).

基于Spark2.2新闻网大数据实时系统项目

A library that provides useful extensions to Apache Spark and PySpark.

A simplified, lightweight ETL Framework based on Apache Spark

Apache Hive

Moonbox is a DVtaaS (Data Virtualization as a Service) Platform

80+ DevOps & Data CLI Tools - AWS, GCP, GCF Python Cloud Function, Log Anonymizer, Spark, Hadoop, HBase, Hive, Impala, Linux, Docker, Spark Data Converters & Validators (Avro/Parquet/JSON/CSV/INI/XML/YAML), Travis CI, AWS CloudFormation, Elasticsearch, Solr etc.

Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)

Relation Extraction using Deep learning(CNN)

大数据入门指南 ⭐

专注大数据学习面试，大数据成神之路开启。Flink/Spark/Hadoop/Hbase/Hive...

Basin is a visual programming editor for building Spark and PySpark pipelines. Easily build, debug, and deploy complex ETL pipelines from your browser

Web UI for Trino, Presto, Hive, Elasticsearch, SparkSQL