840 Open source projects that are alternatives of or similar to Shifu

Python library for creating data pipelines with chain functional programming

Based on Apache Flink. support data synchronization/integration and streaming SQL computation.

c++ LINQ -like library of higher-order functions for data manipulation

zUMIs: A fast and flexible pipeline to process RNA sequencing data with UMIs

Machine learning platform for Web developers

A server that pulls and parses MySQL binlog, pushs change data into different sinks like Kafka.

Apache Hadoop

A Drone plugin for caching current workspace files between builds to reduce your build times

Apache Parquet implementation in Rust

Spark、Flink等离线任务的调度以及实时任务的监控

Demo of Jenkins Configuration-As-Code with Docker and Groovy Hook Scripts

Old archived draft proposal for smart pipelines. Go to the new Hack-pipes proposal at js-choi/proposal-hack-pipes.

A collection of research papers on decision, classification and regression trees with implementations.

The safe post-production pipeline - https://getavalon.github.io/2.0

Big Data Toolkit for the JVM

Jenkins实践文档 最新站点地址: http://www.idevops.site

[爬虫框架 (golang)] An awesome Go concurrent Crawler(spider) framework. The crawler is flexible and modular. It can be expanded to an Individualized crawler easily or you can use the default crawl components only.

Decision Trees, Random Forest, Dynamic Time Warping, Naive Bayes, KNN, Linear Regression, Logistic Regression, Mixture Of Gaussian, Neural Network, PCA, SVD, Gaussian Naive Bayes, Fitting Data to Gaussian, K-Means

AI on Hadoop

A Lightweight Decision Tree Framework supporting regular algorithms: ID3, C4,5, CART, CHAID and Regression Trees; some advanced techniques: Gradient Boosting (GBDT, GBRT, GBM), Random Forest and Adaboost w/categorical features support for Python

wcm.io Jenkins Pipeline Library for CI/CD

Learn how to build a CI/CD pipeline for SAM-based applications

Distributed malware processing framework based on Python, Redis and MinIO.

☔️ => ⛅️ => ☀️

A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow

spacy-wordnet creates annotations that easily allow the use of wordnet and wordnet domains by using the nltk wordnet interface

随机森林，Random Forest（RF）

A set of tools to understand what is happening inside a Random Forest

TipDM建模平台，开源的数据挖掘工具。

Elastic Crontab System 简单易用的分布式定时任务管理系统

.NET for Apache® Spark™ makes Apache Spark™ easily accessible to .NET developers.

all kinds of scrapy demo

Fluid dynamics component of Chemical Engineering Design Library (ChEDL)

An Airflow docker image preconfigured to work well with Spark and Hadoop/EMR

Ephemeral Hadoop clusters using Google Compute Platform

pypyr task-runner cli & api for automation pipelines. Automate anything by combining commands, different scripts in different languages & applications into one pipeline process.

MATLAB library for non-negative matrix factorization (NMF): Version 1.8.1

Griffon Data Science Virtual Machine

Sort files and pack them into partitions

Open solution to the Toxic Comment Classification Challenge

A Cloud Native Batch System (Project under CNCF)

Handwritten Digit Recognition using Machine Learning and Deep Learning

Jenkins pipeline steps which provides SSH facilities such as command execution or file transfer for continuous delivery.

Function Composition for OpenFaaS

最全的Java技术知识点，以及Java源码分析。为开源贡献自己的一份力。

ML based projects such as Spam Classification, Time Series Analysis, Text Classification using Random Forest, Deep Learning, Bayesian, Xgboost in Python

A complete pipeline for metagenomic analysis

Machine Learning inference engine for Microcontrollers and Embedded devices

PipelineX: Python package to build ML pipelines for experimentation with Kedro, MLflow, and more

A repository for setting up a RNAseq workflow

Pipeline Extension for Live Trading

A simpler way of reading and augmenting image segmentation data into TensorFlow

Read and write Parquet in Scala. Use Scala classes as schema. No need to start a cluster.

基于Spark的电影推荐系统，包含爬虫项目、web网站、后台管理系统以及spark推荐系统

A New, Interactive Approach to Learning Data Science

Detect germline or somatic variants from normal or tumour/normal whole-genome or targeted sequencing

This projects gives Kotlin bindings and several extensions for Apache Spark. We are looking to have this as a part of Apache Spark 3.x

Suite of tools for deploying and training deep learning models using the JVM. Highlights include model import for keras, tensorflow, and onnx/pytorch, a modular and tiny c++ library for running math code and a java based math library on top of the core c++ library. Also includes samediff: a pytorch/tensorflow like library for running deep learni…

mito ETL tool

Open solution to the TGS Salt Identification Challenge