Top 9 azkaban open source projects

大数据入门指南 ⭐

✭ 10,991

java scala kafka spark big-data yarn hadoop phoenix zookeeper bigdata hive hbase hdfs mapreduce storm flume azkaban sqoop

Incubator Dolphinscheduler

Apache DolphinScheduler is a distributed and extensible workflow scheduler platform with powerful DAG visual interfaces, dedicated to solving complex job dependencies in the data pipeline and providing various types of jobs available out of box.

God Of Bigdata

专注大数据学习面试，大数据成神之路开启。Flink/Spark/Hadoop/Hbase/Hive...

✭ 6,008

kafka spark hadoop zookeeper bigdata flink hive hbase hdfs flume azkaban

Azkaban

Azkaban workflow manager.

✭ 3,914

java javascript Less CSS shell HTML hacktoberfest workflow-engine scheduling azkaban

litemall-dw

基于开源Litemall电商项目的大数据项目，包含前端埋点(openresty+lua)、后端埋点；数据仓库(五层)、实时计算和用户画像。大数据平台采用CDH6.3.2(已使用vagrant+ansible脚本化)，同时也包含了Azkaban的workflow。

✭ 36

java javascript Vue scala SCSS CSS redis vagrant kafka spring-boot hive solr clickhouse hbase spark-streaming openresty flume oozie flink azkaban spark-sql maxwell cdh6

TitanDataOperationSystem

最好的大数据项目。《Titan数据运营系统》，本项目是一个全栈闭环系统，我们有用作数据可视化的web系统，然后用flume-kafaka-flume进行日志的读取，在hive设计数仓，编写spark代码进行数仓表之间的转化以及ads层表到mysql的迁移，使用azkaban进行定时任务的调度，使用技术：Java/Scala语言，Hadoop、Spark、Hive、Kafka、Flume、Azkaban、SpringBoot，Bootstrap， Echart等；

✭ 62

javascript HTML CSS SCSS java scala kafka spark hive hadoop flume azkaban

BookRecommenderSystem

基于大数据的图书推荐系统

✭ 30

redis kafka spark mongodb vue springboot flume azkaban element-ui

ETL-Starter-Kit

📁 Extract, Transform, Load (ETL) 👷 refers to a process in database usage and especially in data warehousing. This repository contains a starter kit featuring ETL related work.

✭ 21

scala groovy hive gradle bigdata datascience pig scalding azkaban datamining starter-project etl-framework mapreduce-jobs

common-datax

基于DataX的通用数据同步微服务，一个Restful接口搞定所有通用数据同步

✭ 51

java FreeMarker redis hive freemarker mybatis azkaban mybatis-plus datax springboot2 dynamic-datasource

1-9 of 9 azkaban projects