The module was moved to MLToolkit
abrazinskas / machine-learning-data-pipeline
Licence: other
Pipeline module for parallel real-time data processing for machine learning models development and production purposes.
Stars: ✭ 22
Labels
Projects that are alternatives of or similar to machine-learning-data-pipeline
prosto
Prosto is a data processing toolkit radically changing how data is processed by heavily relying on functions and operations with functions - an alternative to map-reduce and join-groupby
Stars: ✭ 54 (+145.45%)
Mutual labels: data-preprocessing, data-processing, data-preparation
sparklanes
A lightweight data processing framework for Apache Spark
Stars: ✭ 17 (-22.73%)
Mutual labels: data-preprocessing, data-processing
trembita
Model complex data transformation pipelines easily
Stars: ✭ 44 (+100%)
Mutual labels: parallel, data-pipeline
SumStatsRehab
GWAS summary statistics files QC tool
Stars: ✭ 19 (-13.64%)
Mutual labels: data-preprocessing, data-preparation
Parrows
Using Arrows to model parallel processes/computations.
Stars: ✭ 18 (-18.18%)
Mutual labels: parallel, computing
saisoku
Saisoku is a Python module that helps you build complex pipelines of batch file/directory transfer/sync jobs.
Stars: ✭ 40 (+81.82%)
Mutual labels: data-pipeline
Neural-Network-Compression-and-Accelerator-on-Hardware
My name is Fang Biao. I'm currently pursuing my Master degree with the college of Computer Science and Engineering, Si Chuan University, Cheng Du, China. For more informantion about me and my research, you can go to [my homepage](https://github.com/hisrg). One of my research interests is architecture design for deep learning and neuromorphic com…
Stars: ✭ 30 (+36.36%)
Mutual labels: computing
nuts-ml
Flow-based data pre-processing for deep learning
Stars: ✭ 32 (+45.45%)
Mutual labels: data-preprocessing
quagmire
Python surface process framework on highly scalable unstructured meshes
Stars: ✭ 13 (-40.91%)
Mutual labels: parallel
ob bulkstash
Bulk Stash is a docker rclone service to sync, or copy, files between different storage services. For example, you can copy files either to or from a remote storage services like Amazon S3 to Google Cloud Storage, or locally from your laptop to a remote storage.
Stars: ✭ 113 (+413.64%)
Mutual labels: data-pipeline
Linux-Kernel-Driver-Programming
Implementation of PCI drivers, kprobe, sysfs, devfs, sensor driver, miscdevices, synchronization
Stars: ✭ 43 (+95.45%)
Mutual labels: parallel
noroutine
Goroutine analogue for Node.js, spreads I/O-bound routine calls to utilize thread pool (worker_threads) using balancer with event loop utilization. 🌱
Stars: ✭ 86 (+290.91%)
Mutual labels: parallel
video features
Extract video features from raw videos using multiple GPUs. We support RAFT and PWC flow frames as well as S3D, I3D, R(2+1)D, VGGish, CLIP, ResNet features.
Stars: ✭ 225 (+922.73%)
Mutual labels: parallel
Parallel-NDJSON-Reader
Parallel NDJSON Reader for Python
Stars: ✭ 13 (-40.91%)
Mutual labels: parallel
pyfuncol
Functional collections extension functions for Python
Stars: ✭ 32 (+45.45%)
Mutual labels: parallel
pareach
a tiny function that "parallelizes" work in NodeJS
Stars: ✭ 19 (-13.64%)
Mutual labels: parallel
Galaxy
Galaxy is an asynchronous parallel visualization ray tracer for performant rendering in distributed computing environments. Galaxy builds upon Intel OSPRay and Intel Embree, including ray queueing and sending logic inspired by TACC GraviT.
Stars: ✭ 18 (-18.18%)
Mutual labels: parallel
rTRNG
R package providing access and examples to TRNG C++ library
Stars: ✭ 17 (-22.73%)
Mutual labels: parallel
Note that the project description data, including the texts, logos, images, and/or trademarks,
for each open source project belongs to its rightful owner.
If you wish to add or remove any projects, please contact us at [email protected].