276 Open source projects that are alternatives of or similar to etl_manager

Virtual Machine for Desktop Search with Open Semantic Search

A lib to transform data from jdbc,csv,json to ecah other.

Generate beautiful documentation for your data pipelines in markdown format

Useful SQL queries for Blockchain ETL datasets in BigQuery.

Odoo Integration Addons

ETH PhD Program course

为DataX(https://github.com/alibaba/DataX) 提供远程多语言调用（ThriftServer，HttpServer） 分布式运行（DataX on YARN） 功能

Clean APIs for data cleaning. Python implementation of R package Janitor

GAMECHANGER aspires to be the Department’s trusted solution for evidence-based, data-driven decision-making across the universe of DoD requirements

一款基于kettle的数据处理web调度控制平台，支持文档资源库和数据库资源库，通过web平台控制kettle数据转换，可作为中间件集成到现有系统中

The practical use-cases of how to make your Machine Learning Pipelines robust and reliable using Apache Airflow.

Basin is a visual programming editor for building Spark and PySpark pipelines. Easily build, debug, and deploy complex ETL pipelines from your browser

A comprehensive list of 180+ YouTube Channels for Data Science, Data Engineering, Machine Learning, Deep learning, Computer Science, programming, software engineering, etc.

In-memory Java DataFrame library

DE or DIE meetup made by data engineers for data engineers. Currently in Russian only.

Rivery CLI

funsies is a lightweight workflow engine 🔧

Python3 lib and cli for operating a Cardano Passive Node and using the API's. (PRE-ALPHA)

Flock: A Low-Cost Streaming Query Engine on FaaS Platforms

JobAnalytics system consumes data from multiple sources and provides valuable information to both job hunters and recruiters.

dbd is a database prototyping tool that enables data analysts and engineers to quickly load and transform data in SQL databases.

Starlake is a Spark Based On Premise and Cloud ELT/ETL Framework for Batch & Stream Processing

Real-Time Event Streaming & Change Data Capture

Yet Another ETL in PHP

Multi-core processing of 'Gameday' data from Major League Baseball Advanced Media. Additional tools to parallelize large data sets and write them to a database.

proc(ess)-that - easy extendable ETL tool for Node.js. Written in TypeScript.

A persistence framework for game developers

Datart is a next generation Data Visualization Open Platform

Monitoring tool to measure flow throughput of data sources and processing components that are part of Data Ingestion and ETL pipelines.

大数据采集,抽取平台

🇨🇳 MyDataHarbor是一个致力于解决任意数据源到任意数据源的分布式、高扩展性、高性能、事务级的数据同步中间件。帮助用户可靠、快速、稳定的对海量数据进行准实时增量同步或者定时全量同步，主要定位是为实时交易系统服务，亦可用于大数据的数据同步（ETL领域）。

BETL. Meta data driven ETL generation using T-SQL

The OpenRefine Python Client from Paul Makepeace provides a library for communicating with an OpenRefine server. This fork extends the command line interface (CLI) and is distributed as a convenient one-file-executable (Windows, Linux, Mac). It is also available via Docker Hub, PyPI and Binder.

Python client for using Prefect Cloud with Saturn Cloud

ETL for OIC Options Chains

⚙️ Schedule notebooks, run them like APIs, expose securely your assets: Jupyter as a viable ⚡️ Production environment

A collection of online resources to help you on your Tech journey.

Live import all your Google Sheets to your data warehouse

Open Source Feature Flagging and A/B Testing Platform

Summary of my projects on kaggle

Viewflow is an Airflow-based framework that allows data scientists to create data models without writing Airflow code.

数据采集平台zdh,etl 处理服务

Dummy variable generation with fit/transform capabilities

The Taxonomy for ETL Automation Metadata (TEAM) is a metadata management tool for data warehouse automation. It is part of the ecosystem for data warehouse automation, alongside the Virtual Data Warehouse pattern manager and the generic schema for Data Warehouse Automation.

Easy way to define, execute and store quality rules for your data.

Code relating to scraping public police data.

DEPRECATED: Stream data processing micro-framework

Tool and library to convert ETW logs to JSON files

Shell script to run OpenRefine in batch mode (import, transform, export). It orchestrates OpenRefine (server) and a python client that communicates with the OpenRefine API.

Configurable data bridge for permanent ETL jobs

ETL flow framework based on Yaml configs in Python

A curated list of big data engineering tools, resources and communities.

Deep Neural Network architecture as a predictive optimal controller for {HVAC+Solar cell + battery} disturbance afflicted system vs classic Model Predictive Control

bqloader is a simple ETL framework to load data from Cloud Storage into BigQuery.

ETL for the IEX Stocks API

A curated list of awesome system integration software and resources.

A COBOL parser and Mainframe/EBCDIC data source for Apache Spark

JDBC driver for Neo4j

A model-driven dynamically-configurable framework to acquire data from external sources and save it to your database.

Python ETL(Extract-Transform-Load) tool / Data migration tool