720 Open source projects that are alternatives of or similar to mydataharbor

A lightweight data processing framework for Apache Spark

A lib to transform data from jdbc,csv,json to ecah other.

Configurable data bridge for permanent ETL jobs

A lightweight stream processing library for Go

Basin is a visual programming editor for building Spark and PySpark pipelines. Easily build, debug, and deploy complex ETL pipelines from your browser

Stetl, Streaming ETL, is a lightweight geospatial processing and ETL framework written in Python.

JDBC driver for Neo4j

mito ETL tool

M-Lab ingestion pipeline

A simple Spark-powered ETL framework that just works 🍺

Airbyte is an open-source EL(T) platform that helps you replicate your data in your warehouses, lakes and databases.

consume maxwell generated message from kafka,export it to another mysql.

Generate beautiful documentation for your data pipelines in markdown format

A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow

ETL Library for Machine Learning - data pipelines, data munging and wrangling

Provides guidance for fast ETL jobs, an IDataReader implementation for SqlBulkCopy (or the MySql or Oracle equivalents) that wraps an IEnumerable, and libraries for mapping entites to table columns.

⚙️ Schedule notebooks, run them like APIs, expose securely your assets: Jupyter as a viable ⚡️ Production environment

💞 《服务端》| 服务端同样使用Netty4.x作为socket的通信框架，同时在服务端使用Layui作为管理后台的页面，并且我们的服务端采用偏向于DDD领域驱动设计的方式与Netty集合，以此来达到我们的框架结构整洁干净易于扩展。同时我们的通信协议也是在服务端进行定义的，并对外提供可引入的Jar包，这样来保证客户端与服务端共同协议下进行通信。

A rapid http(s) benchmark tool written in Go

HTML processing filters and utilities in Go version

create a jenkins pipeline which uses terraform to manage AWS resources

Catalyst.Classification

R pipeline for computing persistent homology in topological data analysis. See https://doi.org/10.21105/joss.00860 for more details.

A library for binding information from java.sql.DatabaseMetadata

An example of how to run Rails CI and test steps in parallel with Docker and Buildkite

EtlFlow is an ecosystem of functional libraries in Scala based on ZIO for writing various different tasks, jobs on GCP and AWS.

Java wrapper and Jdbc driver for SQLite using JNA or Bridj or JNR or JNI or JavaCPP.

A curated collection of publicly available resources on how companies around the world practice DevOps

A pure bash clojureish CI pipeline

A python library to manipulate and transform indexable data (lists, arrays, ...)

Framework for Creating Pipeline Software

bqloader is a simple ETL framework to load data from Cloud Storage into BigQuery.

☁️ nodejs kafka connect connector for Google BigQuery

A framework designed around Kotlin providing Restful HTTP Client, JDBC DSL, Loading Cache, Configurations, Validations, and more

code, labs and lectures for the course

A COBOL parser and Mainframe/EBCDIC data source for Apache Spark

A pipelined implementation of the MIPS processor featuring hazard detection as well as forwarding

Continuous Integration Platform

No description or website provided.

🔬 De novo assembly of nanopore reads using nextflow

Content builder library for MonoGame.

A CLI and library to run Singer Taps and Targets

A simple command line Java application to test JDBC connection to Oracle database

No description or website provided.

Use AutoAI to detect fraud

CubETL - Framework and tool for data ETL (Extract, Transform and Load) in Python (PERSONAL PROJECT / SELDOM MAINTAINED)

Kotlin SQL Mapper

Extensible streaming ingestion pipeline on top of Apache Spark

The Rx Asset Management System for motion picture production

Plugin for Jenkins v2.138.2 or later, that triggers job builds on Bitbucket's push and pull request events.

Show Me A Graph - Command Line Graphing

Code relating to scraping public police data.

Apache-Spark based Data Flow(ETL) Framework which supports multiple read, write destinations of different types and also support multiple categories of transformation rules.

An alternative to the "hive standalone" jar for connecting Java applications to Apache Hive via JDBC

SQL backend to dplyr for Impala

A lightweight, distributed workflow system

pipen - A pipeline framework for python

一款操作数据库的小工具

Toolbox for generic NGS analyses - A framework to quickly build pipelines and to perform large-scale NGS analysis