GitPlanet

Cheap and reliable Node.js hosting starts at $3/month, and $1/month static HTML hosting

Created with love in Canada, visit hostnodejs.com today

Feel like to post an Ad? Learn Details
All Projects → baifendian → swordfish

baifendian / swordfish

Licence: other
Open-source distribute workflow schedule tools, also support streaming task.

Programming Languages

java
68154 projects - #9 most used programming language
python
139335 projects - #7 most used programming language

Labels

sparkhivehadoopschedulerhbase

Projects that are alternatives of or similar to swordfish

Wedatasphere
WeDataSphere is a financial level one-stop open-source suitcase for big data platforms. Currently the source code of Scriptis and Linkis has already been released to the open-source community. WeDataSphere, Big Data Made Easy!
Stars: ✭ 372 (+962.86%)
Mutual labels:  spark, hive, hadoop, scheduler, hbase
Hadoop cookbook
Cookbook to install Hadoop 2.0+ using Chef
Stars: ✭ 82 (+134.29%)
Mutual labels:  spark, hive, hadoop, hbase
Bigdata Notes
大数据入门指南 ⭐
Stars: ✭ 10,991 (+31302.86%)
Mutual labels:  spark, hive, hadoop, hbase
Repository
个人学习知识库涉及到数据仓库建模、实时计算、大数据、Java、算法等。
Stars: ✭ 92 (+162.86%)
Mutual labels:  spark, hive, hadoop, hbase
BigData-News
基于Spark2.2新闻网大数据实时系统项目
Stars: ✭ 36 (+2.86%)
Mutual labels:  spark, hive, hadoop, hbase
Bigdata docker
Big Data Ecosystem Docker
Stars: ✭ 161 (+360%)
Mutual labels:  spark, hive, hadoop, hbase
Szt Bigdata
深圳地铁大数据客流分析系统🚇🚄🌟
Stars: ✭ 826 (+2260%)
Mutual labels:  spark, hive, hadoop, hbase
God Of Bigdata
专注大数据学习面试，大数据成神之路开启。Flink/Spark/Hadoop/Hbase/Hive...
Stars: ✭ 6,008 (+17065.71%)
Mutual labels:  spark, hive, hadoop, hbase
Bigdataguide
大数据学习，从零开始学习大数据，包含大数据学习各阶段学习视频、面试资料
Stars: ✭ 817 (+2234.29%)
Mutual labels:  spark, hive, hadoop, hbase
Weblogsanalysissystem
A big data platform for analyzing web access logs
Stars: ✭ 37 (+5.71%)
Mutual labels:  spark, hadoop, hbase
Apache Spark Hands On
Educational notes,Hands on problems w/ solutions for hadoop ecosystem
Stars: ✭ 74 (+111.43%)
Mutual labels:  spark, hive, hadoop
Dataspherestudio
DataSphereStudio is a one stop data application development& management portal, covering scenarios including data exchange, desensitization/cleansing, analysis/mining, quality measurement, visualization, and task scheduling.
Stars: ✭ 1,195 (+3314.29%)
Mutual labels:  spark, hive, hadoop
Learning Spark
零基础学习spark，大数据学习
Stars: ✭ 37 (+5.71%)
Mutual labels:  spark, hadoop, hbase
Bigdata Interview
🎯 🌟[大数据面试题]分享自己在网络上收集的大数据相关的面试题以及自己的答案总结.目前包含Hadoop/Hive/Spark/Flink/Hbase/Kafka/Zookeeper框架的面试题知识总结
Stars: ✭ 857 (+2348.57%)
Mutual labels:  spark, hadoop, hbase
Dockerfiles
50+ DockerHub public images for Docker & Kubernetes - Hadoop, Kafka, ZooKeeper, HBase, Cassandra, Solr, SolrCloud, Presto, Apache Drill, Nifi, Spark, Consul, Riak, TeamCity and DevOps tools built on the major Linux distros: Alpine, CentOS, Debian, Fedora, Ubuntu
Stars: ✭ 847 (+2320%)
Mutual labels:  spark, hadoop, hbase
Bdp Dataplatform
大数据生态解决方案数据平台：基于大数据、数据平台、微服务、机器学习、商城、自动化运维、DevOps、容器部署平台、数据平台采集、数据平台存储、数据平台计算、数据平台开发、数据平台应用搭建的大数据解决方案。
Stars: ✭ 456 (+1202.86%)
Mutual labels:  spark, hive, hbase
aaocp
一个对用户行为日志进行分析的大数据项目
Stars: ✭ 53 (+51.43%)
Mutual labels:  hive, hadoop, hbase
Hadoopcryptoledger
Hadoop Crypto Ledger - Analyzing CryptoLedgers, such as Bitcoin Blockchain, on Big Data platforms, such as Hadoop/Spark/Flink/Hive
Stars: ✭ 126 (+260%)
Mutual labels:  spark, hive, hadoop
dpkb
大数据相关内容汇总，包括分布式存储引擎、分布式计算引擎、数仓建设等。关键词：Hadoop、HBase、ES、Kudu、Hive、Presto、Spark、Flink、Kylin、ClickHouse
Stars: ✭ 123 (+251.43%)
Mutual labels:  hive, hadoop, hbase
dockerfiles
Multi docker container images for main Big Data Tools. (Hadoop, Spark, Kafka, HBase, Cassandra, Zookeeper, Zeppelin, Drill, Flink, Hive, Hue, Mesos, ... )
Stars: ✭ 29 (-17.14%)
Mutual labels:  hive, hadoop, hbase
View All Similar Projects ➔

swordfish 编译方法

1.下载 swordfish 源码

$ git clone https://github.com/baifendian/swordfish.git

2.通过maven打包

  $ cd  {swordfish_source_code_home}
  $ mvn -U clean package assembly:assembly -Dmaven.test.skip=true

打包成功，日志显示如下：

  [INFO] BUILD SUCCESS
  [INFO] -----------------------------------------------------------------
  [INFO] Total time: 4.385 s
  [INFO] Finished at: 2017-02-27T16:13:50+08:00
  [INFO] Final Memory: 52M/314M
  [INFO] -----------------------------------------------------------------

在 target 目录下看到 swordfish-all-{version}, 这个目录下面为打包好的项目信息

如何部署

服务部署手册

任务开发

任务开发手册

Restful API

API 说明

Python client

该模块当前仅用于测试, 详情点击 python client

系统设计参考

系统设计参考

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].