1665 Open source projects that are alternatives of or similar to Mara Pipelines

Airbyte is an open-source EL(T) platform that helps you replicate your data in your warehouses, lakes and databases.

Provides guidance for fast ETL jobs, an IDataReader implementation for SqlBulkCopy (or the MySql or Oracle equivalents) that wraps an IEnumerable, and libraries for mapping entites to table columns.

🇨🇳 MyDataHarbor是一个致力于解决任意数据源到任意数据源的分布式、高扩展性、高性能、事务级的数据同步中间件。帮助用户可靠、快速、稳定的对海量数据进行准实时增量同步或者定时全量同步，主要定位是为实时交易系统服务，亦可用于大数据的数据同步（ETL领域）。

Powerful RDF Knowledge Graph Generation with [R2]RML Mappings

Play detective on Reddit: Discover political disinformation campaigns, secret influencers and more

Easy pipelines for pandas DataFrames.

StorageTapper is a scalable realtime MySQL change data streaming, logical backup and logical replication service

Python library for creating data pipelines with chain functional programming

The premier open source Data Quality solution

EnsEMBL Hive - a system for creating and running pipelines on a distributed compute resource

⚙️ Schedule notebooks, run them like APIs, expose securely your assets: Jupyter as a viable ⚡️ Production environment

A Python stream processing engine modeled after Yahoo! Pipes

A lightweight stream processing library for Go

Generate beautiful documentation for your data pipelines in markdown format

Server application to serve U.S. federal spending data via a RESTful API

Linq to database provider.

Configurable Extract, Transform, and Load

A simple Spark-powered ETL framework that just works 🍺

Basin is a visual programming editor for building Spark and PySpark pipelines. Easily build, debug, and deploy complex ETL pipelines from your browser

A React web application to query and share any PostgreSQL database.

The simplest, fastest way to get business intelligence and analytics to everyone in your company 😋

Logical Replication extension for PostgreSQL 13, 12, 11, 10, 9.6, 9.5, 9.4 (Postgres), providing much faster replication than Slony, Bucardo or Londiste, as well as cross-version upgrades.

locopy: Loading/Unloading to Redshift and Snowflake using Python.

A luigi powered analytics / warehouse stack

Udacity Data Engineering Nano Degree (DEND)

mito ETL tool

The CSV to database command line loader

M-Lab ingestion pipeline

Sync data between persistence engines, like ETL only not stodgy

A lightweight data processing framework for Apache Spark

ETL Library for Machine Learning - data pipelines, data munging and wrangling

A python library to push ethereum blockchain data into an sql database.

Linked Data & RDF Manufacturing Tools in Clojure

Stetl, Streaming ETL, is a lightweight geospatial processing and ETL framework written in Python.

Configurable data bridge for permanent ETL jobs

Kiba enhancement for Ruby ETL.

Česká otevřená data

Data processing & ETL framework for Ruby

🦒 Developer tool to visualize relational databases and export schemas for GraphQL API's.

基于spring boot通过java代码调用kette

THIS PROJECT IS ARCHIVED. Volunteer Management System.

🔬 Where students practice and receive automated and human feedback

Sort files and pack them into partitions

backy2: Deduplicating block based backup software for ceph/rbd, image files and devices

⬆️ Rankings with the most active GitHub users in Spain (sorted by public contributions) 🇪🇸

A complete pipeline for metagenomic analysis

PipelineX: Python package to build ML pipelines for experimentation with Kedro, MLflow, and more

Newt DB is a Python object-oriented database with JSONB-based access and search in PostgreSQL

Technical Analysis Library Time-Series

Production PostgreSQL for Kubernetes, from high availability Postgres clusters to full-scale database-as-a-service.

A tool for building feature stores.

🚀 A lightweight, framework-agnostic database migration tool.

A list of publically available audio data that anyone can download for ASR or other speech activities

Ansible playbook to provide a turnkey solution for the Team Edition of Mattermost

A simpler way of reading and augmenting image segmentation data into TensorFlow

Add support to complex resources of PostgreSQL, like data types, array associations, and auxiliary statements (CTE)

Separate test code from test cases in pytest.

Simple API for banking routines using a Clean Architecture in Golang. 💳 💰 💸