319 Open source projects that are alternatives of or similar to rivery_cli

Utility that converts an .etl file containing a Windows network packet capture into .pcapng format.

Starlake is a Spark Based On Premise and Cloud ELT/ETL Framework for Batch & Stream Processing

www.vixtract.ru

Provides guidance for fast ETL jobs, an IDataReader implementation for SqlBulkCopy (or the MySql or Oracle equivalents) that wraps an IEnumerable, and libraries for mapping entites to table columns.

code, labs and lectures for the course

Categorical Query Language IDE

proc(ess)-that - easy extendable ETL tool for Node.js. Written in TypeScript.

A MongoDB to Elasticsearch connector

Enterprise-grade, production-hardened, serverless data lake on AWS

Data pipeline project

ETL scripts for Bitcoin, Litecoin, Dash, Zcash, Doge, Bitcoin Cash. Available in Google BigQuery https://goo.gl/oY5BCQ

A CLI and library to run Singer Taps and Targets

Treats CSV and JSON files as SQL tables, and exports SQL SELECTs back to CSV or JSON.

Thain is a distributed flow schedule platform.

Server application to serve U.S. federal spending data via a RESTful API

OmniDB installed into a Docker container

数据可视化, 数据挖掘, 数据处理 ETL

Siren provides an easy-to-use universal alert, notification, channels management framework for the entire observability infrastructure.

mito ETL tool

Build DataOps platform with Apache Airflow and dbt on AWS

A visual ETL development and debugging tool for big data

Polyaxon Core Client & CLI to streamline MLOps

A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow

💎 Growing collection of VS Code extensions with a fancy name

Play detective on Reddit: Discover political disinformation campaigns, secret influencers and more

Guardian is a tool for extensible and universal data access with automated access workflows and security controls across data stores, analytical systems, and cloud products.

A tool for building feature stores.

🔄 Simple tool for ETL. From SQL to Redis.

一款基于kettle的数据处理web调度控制平台，支持文档资源库和数据库资源库，通过web平台控制kettle数据转换，可作为中间件集成到现有系统中

Pipeline module for parallel real-time data processing for machine learning models development and production purposes.

A Python stream processing engine modeled after Yahoo! Pipes

consume maxwell generated message from kafka,export it to another mysql.

Xenomorph Crawler, a Concise, Declarative and Observable Distributed Crawler(Node / Go / Java / Rust) For Web, RDB, OS, also can act as a Monitor(with Prometheus) or ETL for Infrastructure 💫 多语言执行器，分布式爬虫

Yet Another ETL in PHP

Automated Tool for Optimized Modelling

Building data processing pipelines for documents processing with NLP using Apache NiFi and related services

📘 Making Data, the DataMade Way

数据质量控制系统

equivalent to kafka-connect 🔧 for nodejs ✨🐢🚀✨

BETL. Meta data driven ETL generation using T-SQL

Česká otevřená data

Code relating to scraping public police data.

Udacity Data Engineering Nano Degree (DEND)

Saisoku is a Python module that helps you build complex pipelines of batch file/directory transfer/sync jobs.

(Spatial) data harmonisation with hale studio (formerly HUMBOLDT Alignment Editor)

PHP Flat File Database Manager

Data processing and modelling framework for automating tasks (incl. Python & SQL transformations).

数据采集平台zdh,etl 处理服务

DataSphereStudio is a one stop data application development& management portal, covering scenarios including data exchange, desensitization/cleansing, analysis/mining, quality measurement, visualization, and task scheduling.

an open-source data management platform for knowledge workers (https://github.com/dswarm/dswarm-documentation/wiki)

A luigi powered analytics / warehouse stack

Helps to initialize your database and seed it with some data in a most simple and convenient way.

A Singer.io Target for Postgres

Configuration and definitions of Airflow for OpenTrials

A serverless architecture for orchestrating ETL jobs in arbitrarily-complex workflows using AWS Step Functions and AWS Lambda.

Real estate dagster pipeline

Example DAGs using hooks and operators from Airflow Plugins

Python Client and Toolkit for DataFrames, Big Data, Machine Learning and ETL in Elasticsearch

ETL flow framework based on Yaml configs in Python

Dynamically generate RESTful APIs from the contents of a database table. Provides JSON, XML, and HTML. Supports most popular databases