kingekinge / Spark Submit Ui
This is a based on playframwork for submit spark app
Stars: ✭ 53
Programming Languages
scala
5932 projects
Labels
Projects that are alternatives of or similar to Spark Submit Ui
Pujangga
Pujangga - Indonesian Natural Language Processing Tool with REST API, an Interface for InaNLP and Deeplearning4j's Word2Vec
Stars: ✭ 47 (-11.32%)
Mutual labels: play-framework
Play Reactive Slick
This is Play Template with a nice User Interface. If you want to use Play as web framework and Postgres as Database then this demo project can be used as a starting point for your application.
Stars: ✭ 40 (-24.53%)
Mutual labels: play-framework
Real Time Stream Processing Engine
This is an example of real time stream processing using Spark Streaming, Kafka & Elasticsearch.
Stars: ✭ 37 (-30.19%)
Mutual labels: spark
Vagrant Projects
Vagrant projects for various use-cases with Spark, Zeppelin, IPython / Jupyter, SparkR
Stars: ✭ 34 (-35.85%)
Mutual labels: spark
Spark As Service Using Embedded Server
This application comes as Spark2.1-as-Service-Provider using an embedded, Reactive-Streams-based, fully asynchronous HTTP server
Stars: ✭ 46 (-13.21%)
Mutual labels: spark
Optimus
🚚 Agile Data Preparation Workflows made easy with dask, cudf, dask_cudf and pyspark
Stars: ✭ 986 (+1760.38%)
Mutual labels: spark
Delta Architecture
Streaming data changes to a Data Lake with Debezium and Delta Lake pipeline
Stars: ✭ 43 (-18.87%)
Mutual labels: spark
Weblogsanalysissystem
A big data platform for analyzing web access logs
Stars: ✭ 37 (-30.19%)
Mutual labels: spark
Awesome Recommendation Engine
The purpose of this tiny project is to put things together with the know how that i learned from the course big data expert from formacionhadoop.com The idea is to show how to play with apache spark streaming, kafka,mongo, spark machine learning algorithms.
Stars: ✭ 47 (-11.32%)
Mutual labels: spark
Play26 Swagger Reactivemongo
A fully featured CRUD app built with Play 2.6, Swagger and ReactiveMongo
Stars: ✭ 36 (-32.08%)
Mutual labels: play-framework
Gatk
Official code repository for GATK versions 4 and up
Stars: ✭ 1,002 (+1790.57%)
Mutual labels: spark
Spark Tda
SparkTDA is a package for Apache Spark providing Topological Data Analysis Functionalities.
Stars: ✭ 45 (-15.09%)
Mutual labels: spark
spark-submit-ui
这是一个基于playframwork开发，web管理的spark应用程序
你需要安装SBT和Java以及PlayFramowrk。项目基于2.2.x 版本开发，需要PlayFramowrk 2.2或更高版本。
测试环境
- JDK8
- Center OS 6.5
- Spark 1.5.2
- Hadoop 2.6.0
- Scala 2.11
主要功能
- hadoop metrics 数据监控
- spark 集群状态信息展示
- 完善的spark app 提交与管理
- 任务状态监控，状态推送
并下载并安装Play Framework 编译环境
修改配置文件，将集群地址替换为你的
文件路径在
conf/web-site.conf
编译与运行
然后去 http://localhost:9000 查看正在运行的服务器。
如果运行有这个界面提示，点击Apply this script now 初始化数据表
编译与运行
activator run
项目默认使用H2数据库
这是Play 内嵌的一个数据库 H2 H2官方介绍 http://www.h2database.com/html/main.html
如果想要换成Mysql或者是其他的存储可以参考指引 MySQL 数据库引擎连接属性 配置文件 conf/application.conf
db.default.driver=com.mysql.jdbc.Driver db.default.url="jdbc:mysql://localhost/playdb" db.default.user=playdbuser db.default.pass="a strong password"
#其他
通过界面管理，kill或者rerun任务
如果你的提交参数或配置导致异常，可以在提交时查看相关的错误输出
#Link:
IntelliJ IDE支持Maven的和为Scala提供了插件开发.
IntelliJ download: https://www.jetbrains.com/idea/
IntelliJ Scala Plugin: http://plugins.jetbrains.com/plugin/?id=1347
playframework:https://www.playframework.com
sbt:http://www.scala-sbt.org
spark:http://spark.apache.org
Note that the project description data, including the texts, logos, images, and/or trademarks,
for each open source project belongs to its rightful owner.
If you wish to add or remove any projects, please contact us at [email protected].