363 Open source projects that are alternatives of or similar to machine-learning-data-pipeline

Multiphysics Object Oriented Simulation Environment

Integrating the Best of TF into PyTorch, for Machine Learning, Natural Language Processing, and Text Generation. This is part of the CASL project: http://casl-project.ai/

Build and deploy a serverless data pipeline on AWS with no effort.

List of libraries, tools and APIs for web scraping and data processing.

📈 Adaptive: parallel active learning of mathematical functions

Command line tool to download and extract data from HTML/XML pages or JSON-APIs, using CSS, XPath 3.0, XQuery 3.0, JSONiq or pattern matching. It can also create new or transformed XML/HTML/JSON documents.

Asynchronous Programming Library for JavaScript & Node.js

A GPU-accelerated library containing highly optimized building blocks and an execution engine for data processing to accelerate deep learning training and inference applications.

Extended Memory Semantics - Persistent shared object memory and parallelism for Node.js and Python

Super fast list of dicts to pre-formatted tables conversion library for Python 2/3

Functional collections extension functions for Python

Baleen 3 is a data processing tool based on the Annot8 framework

给爬虫使用的代理IP池

Apache Pulsar client library for Erlang/Elixir

Ray tracer with phong lighting, reflections, refractions, normal mapping, procedural textures, super sampling, and depth of field.

Little DSL to make data processing sane with clojure.spec and spec-tools

⛵️ Beautiful Array utilities for ESnext async/await ~

PREVIEW - SQL databases in Bonobo, using sqlalchemy

WAND-PIC

End-to-end Automatic Speech Recognition for Madarian and English in Tensorflow

distributed dataflows with functional list operations for data processing with C++14

Engine for ML/Data tracking, visualization, dashboards, and model UI for Polyaxon.

LargeScale Multiphysics Scientific Simulation Environment-OneFLOW CFD

System Engineering Memory Map

A hyperparameter optimization framework

Tools for filtering and cleaning parallel and monolingual corpora for machine translation and other natural language processing tasks.

a tiny function that "parallelizes" work in NodeJS

Ontology-driven Linked Data processor and server for SPARQL backends. Apache License.

libMesh github repository

Introduction to Applied Mathematics and Informatics in Drug Discovery (AMIDD)

A pytest plugin for parallel and concurrent testing

Scientific Computing for Chemists text for teaching basic computing skills to chemistry students using Python, Jupyter notebooks, and the SciPy stack. This text makes use of a variety of packages including NumPy, SciPy, matplotlib, pandas, seaborn, NMRglue, SymPy, scikit-image, and scikit-learn.

Easy parallel execution of commands with live feedback

An Additional 100 Ideas for Computing https://samsquire.github.io/ideas4/

28Kb, small memory footprint, single binary that run list of commands in parallel and waits for their termination

Flux, Your Gateway to a Decentralized World. https://home.runonflux.io https://api.runonflux.io https://docs.runonflux.io https://source.runonflux.io https://wiki.runonflux.io

A cross-platform command-line tool for executing jobs in parallel

Foofah: programming-by-example data transformation program synthesizer

The versatile ocean simulator, in pure Python, powered by Bohrium.

🚕 A spreadsheet-like data preparation web app that works over Optimus (Pandas, Dask, cuDF, Dask-cuDF, Spark and Vaex)

Cloe programming language

A list of useful resources to learn Data Engineering from scratch

A collection of various resources, examples, and executables for the general NREL HPC user community's benefit. Use the following website for accessing documentation.

OONI data processing pipeline

A Python module for parallel optimization of expensive black-box functions

Network traffic data pipeline for real-time predictions and building datasets for deep neural networks

Sort files and pack them into partitions

A Node.js and JavaScript synchronous data pipeline processing, data sharing and stream processing library. Actionable & Transformable Pipeline data processing.

Defines IAsyncEnumerable, IAsyncEnumerator, ForEachAsync(), ParallelForEachAsync(), and other useful stuff to use with async-await

JobAnalytics system consumes data from multiple sources and provides valuable information to both job hunters and recruiters.

🚚 Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark

Multi-stream rsync wrapper

SST Structural Simulation Toolkit Parallel Discrete Event Core and Services

sciblox - Easier Data Science and Machine Learning

General, high performance algebraic multigrid solver

Parallel Searching and Crawling Data from PTT 🚀

[READ-ONLY] PHP - ETL (Extract Transform Load) data processing library

Efficient transducers for Julia

Ray Tracing in One Weekend written in Rust

Complete Python Appium framework in 360 degree