744 Open source projects that are alternatives of or similar to sparklanes

Analysis ready CMIP6 data in python the easy way with pangeo tools.

A PySide2 based file and asset manager for animation and CG productions.

Collection of auditory models.

Snakemake based pipeline for RNA-Seq analysis

Extract mfcc vectors and phones from TIMIT dataset

A keyphrase extractor for Persian

Python based Wikidata framework for easy dataframe extraction

A minimalist (geospatial) ETL

🔬 De novo assembly of nanopore reads using nextflow

An example of how to run a Node.js project in Docker in a Buildkite pipeline

Railway oriented programming in Ember

A client for connecting and running DDLs on hive metastore.

A lightweight, distributed workflow system

jgit-spark-connector is a library for running scalable data retrieval pipelines that process any number of Git repositories for source code analysis.

A high performance, high expansion, easy to use framework for AI application. 为AI应用的开发者提供一套统一的高性能、易用的编程框架，快速基于AI全栈服务、开发跨端边云的AI行业应用。

Generalised and highly customisable, hybrid-parallelism, database based, deep learning framework.

ETL for OIC Options Chains

NBi is a testing framework (add-on to NUnit) for Business Intelligence and Data Access. The main goal of this framework is to let users create tests with a declarative approach based on an Xml syntax. By the means of NBi, you don't need to develop C# or Java code to specify your tests! Either, you don't need Visual Studio or Eclipse to compile y…

Event-driven data pipelines

Blog post on ETL pipelines with Airflow

Towhee is a framework that is dedicated to making neural data processing pipelines simple and fast.

UNDER DEVELOPMENT--- Analysis of long non-coding RNAs from RNA-seq datasets

A declarative KubeFlow Management Tool

Routines and data structures for using isarn-sketches idiomatically in Apache Spark

Pytorch Implementation of GoEmotions 😍😢😱

Spark extension for processing large-scale 3D data sets: Astrophysics, High Energy Physics, Meteorology, …

No description or website provided.

Tools for constructing simple make-like pipelines in R.

A data transformation package for deep learning with Autonomio, Keras and TensorFlow.

Functional Pipeline in Go

CVparser is software for parsing or extracting data out of CV/resumes.

🚚 Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark

Engine for ML/Data tracking, visualization, dashboards, and model UI for Polyaxon.

nextNEOpi: a comprehensive pipeline for computational neoantigen prediction

An Elasticsearch client tailored to data science workflows.

Short course on the targets R package

EtlFlow is an ecosystem of functional libraries in Scala based on ZIO for writing various different tasks, jobs on GCP and AWS.

🤖🎩assume-role-arn allows you to easily assume an AWS IAM role in your CI/CD pipelines, without worrying about external dependencies.

A Django app to download, extract and load campaign finance and lobbying activity data from the California Secretary of State's CAL-ACCESS database

The magic message bus

JobAnalytics system consumes data from multiple sources and provides valuable information to both job hunters and recruiters.

Thain is a distributed flow schedule platform.

REPO MOVED TO https://github.com/repetere/jsonstack-data - Data Science and Machine learning in JavaScript

HTML processing filters and utilities in Go version

An optimized docker image includes Android, Kotlin, Flutter sdk.

Redundans is a pipeline that assists an assembly of heterozygous/polymorphic genomes.

A package that makes it trivial to create and evaluate machine learning pipeline architectures.

A pipeline to select optimal markers for microbial phylogenomics and species tree estimation using coalescent and concatenation approaches

High-throughput Redis client for Go with implicit pipelining

NVTabular is a feature engineering and preprocessing library for tabular data designed to quickly and easily manipulate terabyte scale datasets used to train deep learning based recommender systems.

create a jenkins pipeline which uses terraform to manage AWS resources

csvplus extends the standard Go encoding/csv package with fluent interface, lazy stream operations, indices and joins.

DataX 是异构数据广泛使用的离线数据同步工具/平台，实现包括 MySQL、Oracle、SqlServer、Postgre、HDFS、Hive、ADS、HBase、OTS、ODPS 等各种异构数据源之间高效的数据同步功能。

Java tools, helper, common utilities. A replacement of guava, apache-commons, hutool

Google Classroom Data Pipeline

CubETL - Framework and tool for data ETL (Extract, Transform and Load) in Python (PERSONAL PROJECT / SELDOM MAINTAINED)

No description or website provided.

Analysis of Chromosome Conformation Capture data (Hi-C)

📜 A CLI toolkit for extracting and working with your digital history

dMRIPrep is a robust and easy-to-use pipeline for preprocessing of diverse dMRI data. The transparent workflow dispenses of manual intervention, thereby ensuring the reproducibility of the results.