All Projects → allwefantasy → Mlsql

allwefantasy / Mlsql

Licence: apache-2.0
The Programming Language Designed For Big Data and AI

Programming Languages

javascript
184084 projects - #8 most used programming language

Projects that are alternatives of or similar to Mlsql

Kube Batch
A batch scheduler of kubernetes for high performance workload, e.g. AI/ML, BigData, HPC
Stars: ✭ 804 (-36.29%)
Mutual labels:  bigdata
Aws Auto Terminate Idle Emr
AWS Auto Terminate Idle AWS EMR Clusters Framework is an AWS based solution using AWS CloudWatch and AWS Lambda using a Python script that is using Boto3 to terminate AWS EMR clusters that have been idle for a specified period of time.
Stars: ✭ 21 (-98.34%)
Mutual labels:  bigdata
Apache Spark Hands On
Educational notes,Hands on problems w/ solutions for hadoop ecosystem
Stars: ✭ 74 (-94.14%)
Mutual labels:  bigdata
Hadoop For Geoevent
ArcGIS GeoEvent Server sample Hadoop connector for storing GeoEvents in HDFS.
Stars: ✭ 5 (-99.6%)
Mutual labels:  bigdata
Spark Streaming Monitoring With Lightning
Plot live-stats as graph from ApacheSpark application using Lightning-viz
Stars: ✭ 15 (-98.81%)
Mutual labels:  bigdata
Optimus
🚚 Agile Data Preparation Workflows made easy with dask, cudf, dask_cudf and pyspark
Stars: ✭ 986 (-21.87%)
Mutual labels:  bigdata
Gearpump
Lightweight real-time big data streaming engine over Akka
Stars: ✭ 745 (-40.97%)
Mutual labels:  bigdata
Hudi Resources
汇总Apache Hudi相关资料
Stars: ✭ 79 (-93.74%)
Mutual labels:  bigdata
Panther
Detect threats with log data and improve cloud security posture
Stars: ✭ 885 (-29.87%)
Mutual labels:  bigdata
Big Data Engineering Coursera Yandex
Big Data for Data Engineers Coursera Specialization from Yandex
Stars: ✭ 71 (-94.37%)
Mutual labels:  bigdata
10 Weeks
10-weeks of technology exploration
Stars: ✭ 22 (-98.26%)
Mutual labels:  bigdata
Bigdata Interview
🎯 🌟[大数据面试题]分享自己在网络上收集的大数据相关的面试题以及自己的答案总结.目前包含Hadoop/Hive/Spark/Flink/Hbase/Kafka/Zookeeper框架的面试题知识总结
Stars: ✭ 857 (-32.09%)
Mutual labels:  bigdata
Reddit sse stream
A Server Side Event stream to deliver Reddit comments and submissions in near real-time to a client.
Stars: ✭ 39 (-96.91%)
Mutual labels:  bigdata
Bigdataguide
大数据学习,从零开始学习大数据,包含大数据学习各阶段学习视频、面试资料
Stars: ✭ 817 (-35.26%)
Mutual labels:  bigdata
Cleanframes
type-class based data cleansing library for Apache Spark SQL
Stars: ✭ 75 (-94.06%)
Mutual labels:  bigdata
Coding Now
学习记录的一些笔记,以及所看得一些电子书eBooks、视频资源和平常收纳的一些自己认为比较好的博客、网站、工具。涉及大数据几大组件、Python机器学习和数据分析、Linux、操作系统、算法、网络等
Stars: ✭ 750 (-40.57%)
Mutual labels:  bigdata
Autocrawler
Google, Naver multiprocess image web crawler (Selenium)
Stars: ✭ 957 (-24.17%)
Mutual labels:  bigdata
Athena Cli
Presto-like CLI tool for AWS Athena
Stars: ✭ 85 (-93.26%)
Mutual labels:  bigdata
Uproot4
ROOT I/O in pure Python and NumPy.
Stars: ✭ 80 (-93.66%)
Mutual labels:  bigdata
Countly Sdk Cordova
Countly Product Analytics SDK for Cordova, Icenium and Phonegap
Stars: ✭ 69 (-94.53%)
Mutual labels:  bigdata

MLSQL

MLSQL is a Programming Language Designed For Big Data and AI, and it also have a distributed runtime.

Official WebSite

http://www.mlsql.tech

Find more examples on our user guide.

  1. 中文文档
  2. English Docs

Get PreBuild Distribution

  • The lasted version is MLSQL v2.0.1
  • You can download from MLSQL Website
  • Spark 2.4.3/3.0.0 are tested

Run PreBuild Distribution:

cp streamingpro-spark_2.x-x.x.x.tar.gz /tmp
cd /tmp && tar xzvf  streamingpro-spark_2.x-x.x.x.tar.gz
cd /tmp/streamingpro-spark_2.x-x.x.x

## make sure spark distribution is available
## visit http://127.0.0.1:9003
export SPARK_HOME="....." ; ./start-default.sh

Build Distribution

# clone project
git clone https://github.com/allwefantasy/streamingpro .
cd streamingpro

## configure build envs
export MLSQL_SPARK_VERSIOIN=2.4
export DRY_RUN=false 
export DISTRIBUTION=false

## build  
./dev/package.sh

Fork and Contribute

If you are planning to contribute to this repository, we first request you to create an issue at our Issue page even if the topic is not related to source code itself (e.g., documentation, new idea and proposal).

This is an active open source project for everyone, and we are always open to people who want to use this system or contribute to it.

Contributors

  • Zhu William/allwefantasy#gmail.com
  • Chen Fu/cfmcgrady#gmail.com
  • Geng Yifei/pigeongeng#gmail.com
  • wanp1989/wanp1989#126.com
  • chenliang613
  • RebieKong
  • CoderOverflow
  • ghsuzzy
  • xubo245
  • zhuohuwu0603
  • liyubin117
  • 9bbword
  • Slash-Wong/523935329#qq.com
  • anan0120/158989903#qq.com

HitCount


WeChat Group

扫码添加小可爱微信号,添加成功后,发送 mlsql 这5个英文字母进群。

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].