martinprobson / Spark Scala Maven Example
Licence: mit
Example Maven configuration for a Spark, Scala project
Stars: ✭ 45
Programming Languages
scala
5932 projects
Labels
Projects that are alternatives of or similar to Spark Scala Maven Example
Aliyungradleconfig
自用的安卓开源项目工程模板。阿里云远程仓库加速，发布到maven仓库、上传到jcenter，代码混淆、资源混淆，持续集成(CI)，多渠道自动打包。在天朝使用jcenter、mavenCentral及google三个远程仓库，Gradle Sync太慢？一招教你配置阿里云镜像源。init.d/init.gradle
Stars: ✭ 37 (-17.78%)
Mutual labels: maven
Wetech Cms
wetech cms是本人自己整合开发的一套内容管理系统。旨在开发一个通用的、可持续开发集成的、方便扩展的cms系统，目前主要用来替代本人的wordpress博客
Stars: ✭ 40 (-11.11%)
Mutual labels: maven
Bandcamp Api
API wrapper for querying band, album, and track data from bandcamp.com
Stars: ✭ 20 (-55.56%)
Mutual labels: maven
Cloud Based Sql Engine Using Spark
Cloud-based SQL engine using SPARK where data is accessible as JDBC/ODBC data source via Spark ThriftServer.
Stars: ✭ 30 (-33.33%)
Mutual labels: apache-spark
Freemarker Java 8
Library adding java.time support to FreeMarker
Stars: ✭ 37 (-17.78%)
Mutual labels: maven
Ssm redis template
An template based on Maven, using Spring + Spring MVC + mybatis + spring-data-redis frames. It can be used to construct a new Java Web Appliaction quickly
Stars: ✭ 13 (-71.11%)
Mutual labels: maven
Notes
📝 Migrated to(迁移至) https://github.com/Kuangcp/Note 当前仓库已经废弃, 对应的博客网站:
Stars: ✭ 33 (-26.67%)
Mutual labels: maven
Lib I18n
The library `Lib-I18N` allows a developer to bind a key-value pair of a `.properties` file to a [StringBinding]. This makes it very easy to change the language during runtime in a [JavaFX] application.
Stars: ✭ 40 (-11.11%)
Mutual labels: maven
Web Framework For Java
A seed project with spring boot for AngularJS, AngularJs Material, Thymeleaf, RESTful API, MySQL and admin panel based on AdminLTE.
Stars: ✭ 29 (-35.56%)
Mutual labels: maven
Spark Flamegraph
Easy CPU Profiling for Apache Spark applications
Stars: ✭ 30 (-33.33%)
Mutual labels: apache-spark
Dblink
Distributed Bayesian Entity Resolution in Apache Spark
Stars: ✭ 38 (-15.56%)
Mutual labels: apache-spark
Spark Streaming Monitoring With Lightning
Plot live-stats as graph from ApacheSpark application using Lightning-viz
Stars: ✭ 15 (-66.67%)
Mutual labels: apache-spark
Spring Web Rss Channels
A Full Stack RSS Reader web application built with Spring MVC and JSP. It uses libraries like Spring, JPA, Bootstrap, Apache Tiles, JSP etc. There is also a static code analysis tool called Checkstyle.
Stars: ✭ 40 (-11.11%)
Mutual labels: maven
Live log analyzer spark
Spark Application for analysis of Apache Access logs and detect anamolies! Along with Medium Article.
Stars: ✭ 14 (-68.89%)
Mutual labels: apache-spark
Real Time Stream Processing Engine
This is an example of real time stream processing using Spark Streaming, Kafka & Elasticsearch.
Stars: ✭ 37 (-17.78%)
Mutual labels: apache-spark
Spark Tda
SparkTDA is a package for Apache Spark providing Topological Data Analysis Functionalities.
Stars: ✭ 45 (+0%)
Mutual labels: apache-spark
Example Maven Project for Scala Spark 2 Application
Introduction
This archive contains an example Maven project for Scala Spark 2 application.
Details
The pom.xml contains example dependencies for : -
- Spark
- SLF4J
- LOG4J (acts as logging implementation for SLF4J)
- grizzled-slf4 a Scala specific wrapper for SLF4J.
- typesafe for config.
- scalatest for testing.
Note that Scala itself is just listed as another dependency which means a global installation of Scala is not required.
The pom.xml builds an uber-jar containing all the dependencies by default (including Scala jars).
The pom also includes two exec goals: -
-
exec:[email protected]- run the code using local spark instance. -
exec:[email protected]- run the code on a remote yarn cluster. In order for this to work thehive-site.xml,core-site.xmlandyarn-site.xmlconfiguration files from the remote cluster must be copied into thespark-remote/confdirectory.
Reference
Note that the project description data, including the texts, logos, images, and/or trademarks,
for each open source project belongs to its rightful owner.
If you wish to add or remove any projects, please contact us at [email protected].