All Projects → crackcell → hpipe

crackcell / hpipe

Licence: GPL-2.0 license
Workflow engine for various computing systems.

Programming Languages

go
31211 projects - #10 most used programming language
Makefile
30231 projects

Projects that are alternatives of or similar to hpipe

Etl unicorn
数据可视化, 数据挖掘, 数据处理 ETL
Stars: ✭ 156 (+500%)
Mutual labels:  data-mining, workflow-engine
pathpy
pathpy is an OpenSource python package for the modeling and analysis of pathways and temporal networks using higher-order and multi-order graphical models
Stars: ✭ 124 (+376.92%)
Mutual labels:  data-mining
XCloud
Official Code for Paper <XCloud: Design and Implementation of AI Cloud Platform with RESTful API Service> (arXiv1912.10344)
Stars: ✭ 58 (+123.08%)
Mutual labels:  data-mining
Hefei ECG TOP1
“合肥高新杯”心电人机智能大赛 —— 心电异常事件预测 TOP1 Solution
Stars: ✭ 109 (+319.23%)
Mutual labels:  data-mining
candis
🎀 A data mining suite for gene expression data.
Stars: ✭ 28 (+7.69%)
Mutual labels:  data-mining
machine learning in python
Demo of basic machine learning models in python with Jupter Notebook
Stars: ✭ 16 (-38.46%)
Mutual labels:  data-mining
tf-idf-python
Term frequency–inverse document frequency for Chinese novel/documents implemented in python.
Stars: ✭ 98 (+276.92%)
Mutual labels:  data-mining
Awesome-DataScience-Cheatsheets
Collection of cheatsheets for data science, machine learning and deep learning :).
Stars: ✭ 48 (+84.62%)
Mutual labels:  data-mining
Network-Embedding-Resources
Network Embedding Survey and Resources
Stars: ✭ 43 (+65.38%)
Mutual labels:  data-mining
sql-cookbook
Common SQL recipes and best practises
Stars: ✭ 68 (+161.54%)
Mutual labels:  data-mining
unify-flowret
A lightweight Java based orchestration engine
Stars: ✭ 57 (+119.23%)
Mutual labels:  workflow-engine
lightflow
A lightweight, distributed workflow system
Stars: ✭ 67 (+157.69%)
Mutual labels:  workflow-engine
BLUELAY
Searches online paste sites for certain search terms which can indicate a possible data breach.
Stars: ✭ 24 (-7.69%)
Mutual labels:  data-mining
chainRec
Mengting Wan, Julian McAuley, "Item Recommendation on Monotonic Behavior Chains", in Proc. of 2018 ACM Conference on Recommender Systems (RecSys'18), Vancouver, Canada, Oct. 2018.
Stars: ✭ 52 (+100%)
Mutual labels:  data-mining
kmeans
A simple implementation of K-means (and Bisecting K-means) clustering algorithm in Python
Stars: ✭ 18 (-30.77%)
Mutual labels:  data-mining
Loan-Approval-Prediction
Loan Application Data Analysis
Stars: ✭ 61 (+134.62%)
Mutual labels:  data-mining
csmath-2021
This mathematics course is taught for the first year Ph.D. students of computer science and related areas @zju
Stars: ✭ 30 (+15.38%)
Mutual labels:  data-mining
DataCon
🏆DataCon大数据安全分析大赛,2019年方向二(恶意代码检测)冠军源码、2020年方向五(恶意代码分析)季军源码
Stars: ✭ 69 (+165.38%)
Mutual labels:  data-mining
dayder
Search lots of data sets for spurious correlations
Stars: ✭ 44 (+69.23%)
Mutual labels:  data-mining
4chanMarkovText
Text Generation using Markov Chains fed by 4chan APIs
Stars: ✭ 28 (+7.69%)
Mutual labels:  data-mining
 _______         __
|   |   |.-----.|__|.-----.-----.
|       ||  _  ||  ||  _  |  -__|
|___|___||   __||__||   __|_____|
         |__|       |__|

Hpipe

Build Status Coverage Status Join the chat at https://gitter.im/crackcell/hpipe

Hpipe is a workflow engine supporting hybrid workflows with built-in support for Hadoop Streaming and Hive.

It is useful in many production scenarios such as offline data processing of click-through-rate prediction for online advertising.

Features

  • Integrate various types of jobs into a uniformed workflow.
  • Job status tracking mechanism: keep job status and auto-resume from breakpoints.
  • Workflow descriptive language based on Graphviz being easy to edit and visualize.

Documentation

Screencasts

Contacts

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].