All Projects → WeBankFinTech → Scriptis

WeBankFinTech / Scriptis

Licence: apache-2.0
Scriptis is for interactive data analysis with script development(SQL, Pyspark, HiveQL), task submission(Spark, Hive), UDF, function, resource management and intelligent diagnosis.

Programming Languages

scala
5932 projects

Projects that are alternatives of or similar to Scriptis

Linkis
Linkis helps easily connect to various back-end computation/storage engines(Spark, Python, TiDB...), exposes various interfaces(REST, JDBC, Java ...), with multi-tenancy, high performance, and resource control.
Stars: ✭ 2,323 (+233.76%)
Mutual labels:  sql, spark, hive, pyspark
incubator-linkis
Linkis helps easily connect to various back-end computation/storage engines(Spark, Python, TiDB...), exposes various interfaces(REST, JDBC, Java ...), with multi-tenancy, high performance, and resource control.
Stars: ✭ 2,459 (+253.3%)
Mutual labels:  spark, hive, pyspark
Dataspherestudio
DataSphereStudio is a one stop data application development& management portal, covering scenarios including data exchange, desensitization/cleansing, analysis/mining, quality measurement, visualization, and task scheduling.
Stars: ✭ 1,195 (+71.7%)
Mutual labels:  spark, hive, hue
Wedatasphere
WeDataSphere is a financial level one-stop open-source suitcase for big data platforms. Currently the source code of Scriptis and Linkis has already been released to the open-source community. WeDataSphere, Big Data Made Easy!
Stars: ✭ 372 (-46.55%)
Mutual labels:  spark, hive, ide
Bigdata docker
Big Data Ecosystem Docker
Stars: ✭ 161 (-76.87%)
Mutual labels:  spark, hive, hue
Quicksql
A Flexible, Fast, Federated(3F) SQL Analysis Middleware for Multiple Data Sources
Stars: ✭ 1,821 (+161.64%)
Mutual labels:  sql, spark, hive
Kyuubi
Kyuubi is a unified multi-tenant JDBC interface for large-scale data processing and analytics, built on top of Apache Spark
Stars: ✭ 363 (-47.84%)
Mutual labels:  sql, spark, hive
Spark With Python
Fundamentals of Spark with Python (using PySpark), code examples
Stars: ✭ 150 (-78.45%)
Mutual labels:  sql, spark, pyspark
Xsql
Unified SQL Analytics Engine Based on SparkSQL
Stars: ✭ 176 (-74.71%)
Mutual labels:  sql, spark, hive
spark-extension
A library that provides useful extensions to Apache Spark and PySpark.
Stars: ✭ 25 (-96.41%)
Mutual labels:  spark, pyspark
data-algorithms-with-spark
O'Reilly Book: [Data Algorithms with Spark] by Mahmoud Parsian
Stars: ✭ 34 (-95.11%)
Mutual labels:  spark, pyspark
Trino
Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)
Stars: ✭ 4,581 (+558.19%)
Mutual labels:  sql, hive
bigdata-fun
A complete (distributed) BigData stack, running in containers
Stars: ✭ 14 (-97.99%)
Mutual labels:  spark, hue
aut
The Archives Unleashed Toolkit is an open-source toolkit for analyzing web archives.
Stars: ✭ 111 (-84.05%)
Mutual labels:  spark, pyspark
basin
Basin is a visual programming editor for building Spark and PySpark pipelines. Easily build, debug, and deploy complex ETL pipelines from your browser
Stars: ✭ 25 (-96.41%)
Mutual labels:  spark, pyspark
BigData-News
基于Spark2.2新闻网大数据实时系统项目
Stars: ✭ 36 (-94.83%)
Mutual labels:  spark, hive
Metorikku
A simplified, lightweight ETL Framework based on Apache Spark
Stars: ✭ 361 (-48.13%)
Mutual labels:  sql, spark
Hive
Apache Hive
Stars: ✭ 4,031 (+479.17%)
Mutual labels:  sql, hive
Yanagishima
Web UI for Trino, Presto, Hive, Elasticsearch, SparkSQL
Stars: ✭ 424 (-39.08%)
Mutual labels:  spark, hive
Moonbox
Moonbox is a DVtaaS (Data Virtualization as a Service) Platform
Stars: ✭ 424 (-39.08%)
Mutual labels:  spark, hive

Scriptis

License

English | Chinese

!This project has been merged into DataSphereStudio

Introduction

Scriptis is for interactive data analysis with script development(SQL, Pyspark, HiveQL), task submission(Spark, Hive), UDF, function, resource management and intelligent diagnosis.

running

Features

  • Script editor: Support multi-language, auto-completion, syntax highlighting and SQL syntax error-correction.

  • Computation engines: Based on Linkis, Scriptis connects with multiple computation engines such as Spark, Hive, Python, etc.

  • Runtime functionality: Complete job life cycle display and intelligent diagnosis.

  • Result set: Multiple result sets support, customized result set alias and one-click visualization.

  • Database Services: Functionalities for database management and files(CVS, Excel) import/export to/from tables.

  • Context: UDFs, custom variables and functions management and sharing.

  • Console: Customized settings for engine parameters, task/engine management and resource isolation/display.

QuickStart

Read the Quick Start Quick Start

Comparison with similar scheduler systems

Comparison

Documentations

Quick Start

Quick Use

User Manual

Compilation

Community

If you desire immediate response, please kindly raise issues to us or scan the below QR code by WeChat and QQ to join our group:

WeChatQQ

License

Scriptis is under the Apache 2.0 license. See the LICENSE file for details

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].