1382 Open source projects that are alternatives of or similar to qwery

Kafka End to End Encryption

A CLI tool for Kafka

Configurable data bridge for permanent ETL jobs

Kattlo CLI Project

Kafka proxy with a simple API, speaking the Redis protocol

Apache Kafka bridge

Service for automatically managing and cleaning up unreferenced data

This repository is a getting started guide to Singer.

Extract, Transform, Load: Any SQL Database in 4 lines of Code.

(Spatial) data harmonisation with hale studio (formerly HUMBOLDT Alignment Editor)

A simplified, lightweight ETL Framework based on Apache Spark

A tool for building feature stores.

Configurable Extract, Transform, and Load

mito ETL tool

A client UI to inspect Kafka topics, consume, produce and much more

A luigi powered analytics / warehouse stack

WeDataSphere is a financial level one-stop open-source suitcase for big data platforms. Currently the source code of Scriptis and Linkis has already been released to the open-source community. WeDataSphere, Big Data Made Easy!

DataX is an open source universal ETL tool that support Cassandra, ClickHouse, DBF, Hive, InfluxDB, Kudu, MySQL, Oracle, Presto(Trino), PostgreSQL, SQL Server

Addax is an open source universal ETL tool that supports most of those RDBMS and NoSQLs on the planet, helping you transfer data from any one place to another.

Pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).

an open-source data management platform for knowledge workers (https://github.com/dswarm/dswarm-documentation/wiki)

📁 Extract, Transform, Load (ETL) 👷 refers to a process in database usage and especially in data warehousing. This repository contains a starter kit featuring ETL related work.

omniparser: a native Golang ETL streaming parser and transform library for CSV, JSON, XML, EDI, text, etc.

Mass processing data with a complete ETL for .net developers

The CSV to database command line loader

swiss-army knife for data

Reads and writes CSV, fixed-length and other flat file formats with a focus on schema definition, configuration and speed.

JupyterLab spreadsheet editor for tabular data (e.g. csv, tsv)

A scalable general purpose micro-framework for defining dataflows. You can use it to create dataframes, numpy matrices, python objects, ML models, etc.

A list of command line tools for manipulating structured text data

A CLI tool to convert CSV / Excel / HTML / JSON / Jupyter Notebook / LDJSON / LTSV / Markdown / SQLite / SSV / TSV / Google-Sheets to a SQLite database file.

Kafka Examples focusing on Producer, Consumer, KStreams, KTable, Global KTable using Spring, Kafka Cluster Setup & Monitoring. Implementing Event Sourcing and CQRS Design Pattern using Kafka

A cross-platform, efficient and practical CSV/TSV toolkit in Golang

Schema registry for CSV, TSV, JSON, AVRO and Parquet schema. Supports schema inference and GraphQL API.

eBay's TSV Utilities: Command line tools for large, tabular data files. Filtering, statistics, sampling, joins and more.

CSV validator, highlighter and formatter plugin for JetBrains Intellij IDEA, PyCharm, WebStorm, ...

CSV parser for Swift

🌀 .NET Event Processing library

www.vixtract.ru

DIRECT, the Data Integration Run-time Execution Control Tool, is a data logistics framework that can be used to monitor, log, audit and control data integration / ETL processes.

Miller is like awk, sed, cut, join, and sort for name-indexed data such as CSV, TSV, and tabular JSON

A fully-featured AWS Athena database driver (+ athenareader https://github.com/uber/athenadriver/tree/master/athenareader)

BETL. Meta data driven ETL generation using T-SQL

A SQLite driver for S3 and Amazon Athena 😳

Fast reading of delimited files

A lib to transform data from jdbc,csv,json to ecah other.

pytablewriter is a Python library to write a table in various formats: CSV / Elasticsearch / HTML / JavaScript / JSON / LaTeX / LDJSON / LTSV / Markdown / MediaWiki / NumPy / Excel / Pandas / Python / reStructuredText / SQLite / TOML / TSV.

csvplus extends the standard Go encoding/csv package with fluent interface, lazy stream operations, indices and joins.

Today I Learned

Mapreduce project by Hadoop, Nutch, AWS EMR, Pig, Tez, Hive

Astro allows rapid and clean development of {Extract, Load, Transform} workflows using Python and SQL, powered by Apache Airflow.

simple framework for containing spreadsheet like data

Automatic backups your web projects bases and files to the clouds via WebDAV.

Apache Avro serializer for .NET

Read csv file from go using tags

PicGo S3 插件

Library for generating avro schema files (.avsc) based on DB tables structure

Migrating S3 Buckets Across AWS Accounts

基于Spark2.2新闻网大数据实时系统项目

Generic S3 server implementation