319 Open source projects that are alternatives of or similar to rivery_cli

Versatile Data Kit (VDK) is an open source framework that enables anybody with basic SQL or Python knowledge to create their own data pipelines.

Beneath is a serverless real-time data platform ⚡️

An orchestration platform for the development, production, and observation of data assets.

Python based Wikidata framework for easy dataframe extraction

Example of an ETL Pipeline using Airflow

ELT Code for your Data Warehouse

dbd is a database prototyping tool that enables data analysts and engineers to quickly load and transform data in SQL databases.

Airbyte is an open-source EL(T) platform that helps you replicate your data in your warehouses, lakes and databases.

Astro allows rapid and clean development of {Extract, Load, Transform} workflows using Python and SQL, powered by Apache Airflow.

The MarkLogic Data Hub: documentation ==>

Blog post on ETL pipelines with Airflow

Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validation, Column extensions, SQL functions, and DataFrame transformations

Quickstep project

🇨🇳 MyDataHarbor是一个致力于解决任意数据源到任意数据源的分布式、高扩展性、高性能、事务级的数据同步中间件。帮助用户可靠、快速、稳定的对海量数据进行准实时增量同步或者定时全量同步，主要定位是为实时交易系统服务，亦可用于大数据的数据同步（ETL领域）。

Lightweight SQLite editor for Windows

A lib to transform data from jdbc,csv,json to ecah other.

A persistence framework for game developers

DBMS Mini Project that basically designed for online music player

A scalable general purpose micro-framework for defining dataflows. You can use it to create dataframes, numpy matrices, python objects, ML models, etc.

👨‍⚕️ A fully featured Clinic Management System based on three tier architecture made using ASP.NET, C# with a well documented README.md file.

Configurable data bridge for permanent ETL jobs

ETL for the NASDAQ symbol file

💾 Magento 1.x Database Backup Manager

Real-Time Event Streaming & Change Data Capture

A schema-aware Scala library for data transformation

A COBOL parser and Mainframe/EBCDIC data source for Apache Spark

一款基于kettle的数据处理web调度控制平台，支持文档资源库和数据库资源库，通过web平台控制kettle数据转换，可作为中间件集成到现有系统中

code, labs and lectures for the course

A CLI and library to run Singer Taps and Targets

OmniDB installed into a Docker container

Build DataOps platform with Apache Airflow and dbt on AWS

💎 Growing collection of VS Code extensions with a fancy name

🔄 Simple tool for ETL. From SQL to Redis.

consume maxwell generated message from kafka,export it to another mysql.

数据质量控制系统

Code relating to scraping public police data.

PHP Flat File Database Manager

an open-source data management platform for knowledge workers (https://github.com/dswarm/dswarm-documentation/wiki)

Configuration and definitions of Airflow for OpenTrials

bqloader is a simple ETL framework to load data from Cloud Storage into BigQuery.

Data ETL & Analysis on the global and Mexican datasets of the COVID-19 pandemic.

JobAnalytics system consumes data from multiple sources and provides valuable information to both job hunters and recruiters.

CubETL - Framework and tool for data ETL (Extract, Transform and Load) in Python (PERSONAL PROJECT / SELDOM MAINTAINED)

csvplus extends the standard Go encoding/csv package with fluent interface, lazy stream operations, indices and joins.

ETL jobs for Firefox Telemetry

Core development repository. gitHub: Vsn 6 (2020 - ), Vsn 5 (2018 - 2020), Vsn 4 (2014-2017). Sourceforge: Vsn 3 (2009-2013), Vsn 1 & 2 (2005-2009)

Shield is a role-based cloud-native user management system, identity & access proxy, and authorization server for your applications and API endpoints.

Apache-Spark based Data Flow(ETL) Framework which supports multiple read, write destinations of different types and also support multiple categories of transformation rules.

Relational data pipelines for the science lab

Universal Database CLI for MySQL, PostgreSQL, and SQLite. Terminal User Interface Application.

A Pachyderm deep learning tutorial for conference workshops

CVparser is software for parsing or extracting data out of CV/resumes.

An Elasticsearch client tailored to data science workflows.

Ruby scripting for pentaho-kettle

网站点击流离线日志分析

A data transformation package for deep learning with Autonomio, Keras and TensorFlow.

A Django app to download, extract and load campaign finance and lobbying activity data from the California Secretary of State's CAL-ACCESS database

Flock: A Low-Cost Streaming Query Engine on FaaS Platforms

The Move to Islandora Kit is an extensible PHP command-line tool for converting source content and metadata into packages suitable for importing into Islandora (or other digital repository and preservations systems).

This repository contains the whole project. This project was intended to exhibit as a DBMS project but it can also act as a web development project as it includes complete front end and back end.