840 Open source projects that are alternatives of or similar to Shifu

A simple longslit spectroscopy pipeline in Python

winutils.exe hadoop.dll and hdfs.dll binaries for hadoop windows

电商用户行为分析大数据平台

The safe post-production pipeline - https://getavalon.github.io/2.0

Declarative continuous deployment for Kubernetes.

SUPRA: Software Defined Ultrasound Processing for Real-Time Applications - An Open Source 2D and 3D Pipeline from Beamforming to B-Mode

A lightweight stream processing library for Go

Big Data Toolkit for the JVM

Data transformations for the ML era

Easy pipelines for pandas DataFrames.

Jenkins实践文档 最新站点地址: http://www.idevops.site

A proposal for adding a useful pipe operator to JavaScript.

A DSL for data-driven computational pipelines

定期更新Hadoop生态圈中常用大数据组件文档 重心依次为: Flink Solr Sparksql ES Scala Kafka Hbase/phoenix Redis Kerberos (项目包含hadoop思维导图 印象笔记 Scala版本简单demo 常用工具类 去敏后的train code 持续更新!!!)

[爬虫框架 (golang)] An awesome Go concurrent Crawler(spider) framework. The crawler is flexible and modular. It can be expanded to an Individualized crawler easily or you can use the default crawl components only.

An Efficient, Scalable and Optimized Python Framework for Deep Forest (2021.2.1)

VisTrails is an open-source data analysis and visualization tool. It provides a comprehensive provenance infrastructure that maintains detailed history information about the steps followed and data derived in the course of an exploratory task: VisTrails maintains provenance of data products, of the computational processes that derive these products and their executions.

a realtime plotting utility for terminal/console with data input from stdin

Decision Trees, Random Forest, Dynamic Time Warping, Naive Bayes, KNN, Linear Regression, Logistic Regression, Mixture Of Gaussian, Neural Network, PCA, SVD, Gaussian Naive Bayes, Fitting Data to Gaussian, K-Means

Implementation of hyperparameter optimization/tuning methods for machine learning & deep learning models (easy&clear)

基于wifi抓取信息的大数据查询分析系统

Machine Learning library for the web and Node.

AI on Hadoop

The GIS Tools for Hadoop are a collection of GIS tools for spatial analysis of big data.

Apache Mnemonic - A non-volatile hybrid memory storage oriented library

编程电子书，电子书，编程书籍，包括C，C#，Docker，Elasticsearch，Git，Hadoop，HeadFirst，Java，Javascript，jvm，Kafka，Linux，Maven，MongoDB，MyBatis，MySQL，Netty，Nginx，Python，RabbitMQ，Redis，Scala，Solr，Spark，Spring，SpringBoot，SpringCloud，TCPIP，Tomcat，Zookeeper，人工智能，大数据类，并发编程，数据库类，数据挖掘，新面试题，架构设计，算法系列，计算机类，设计模式，软件测试，重构优化，等更多分类

A Lightweight Decision Tree Framework supporting regular algorithms: ID3, C4,5, CART, CHAID and Regression Trees; some advanced techniques: Gradient Boosting (GBDT, GBRT, GBM), Random Forest and Adaboost w/categorical features support for Python

Build powerful pipelines in any programming language.

An R-focused pipeline toolkit for reproducibility and high-performance computing

Data science Python notebooks: Deep learning (TensorFlow, Theano, Caffe, Keras), scikit-learn, Kaggle, big data (Spark, Hadoop MapReduce, HDFS), matplotlib, pandas, NumPy, SciPy, Python essentials, AWS, and various command lines.

wcm.io Jenkins Pipeline Library for CI/CD

Sample application and CD Pipeline for DevOps Dojo

🚚 Agile Data Preparation Workflows made easy with dask, cudf, dask_cudf and pyspark

d3 library to build circular graphs

Learn how to build a CI/CD pipeline for SAM-based applications

CORTX Community Object Storage is 100% open source object storage uniquely optimized for mass capacity storage devices.

biglasso: Extending Lasso Model Fitting to Big Data in R

A cross-platform command-line tool for executing jobs in parallel

Distributed malware processing framework based on Python, Redis and MinIO.

Generic Data Ingestion & Dispersal Library for Hadoop

Text Classification Algorithms: A Survey

A flexible, high-performance carrier for machine learning models（『飞桨』服务化部署框架）

☔️ => ⛅️ => ☀️

Modern WebGL state wrapper for PEX: allocate GPU resources (textures, buffers), setup state pipelines and passes, and combine them into commands.

A big data platform for analyzing web access logs

Get protein embeddings from protein sequences

利用pytorch实现图像分类的一个完整的代码，训练，预测，TTA，模型融合，模型部署，cnn提取特征，svm或者随机森林等进行分类，模型蒸馏，一个完整的代码

A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow

Iceberg is a table format for large, slow-moving tabular data

A pipelining tool to automate and standardise bioinformatics analyses on cluster environments.

Apache ORC - the smallest, fastest columnar storage for Hadoop workloads

spacy-wordnet creates annotations that easily allow the use of wordnet and wordnet domains by using the nltk wordnet interface

零基础学习spark，大数据学习

Airbyte is an open-source EL(T) platform that helps you replicate your data in your warehouses, lakes and databases.

Fundamentals of Spark with Python (using PySpark), code examples

System for containerized apps management. From build to scaling.

A Julia machine learning framework

A Java NIO file system provider for HDFS

DataX is an open source universal ETL tool that support Cassandra, ClickHouse, DBF, Hive, InfluxDB, Kudu, MySQL, Oracle, Presto(Trino), PostgreSQL, SQL Server

Displays CI statuses on a dashboard and triggers fun modules representing the status!