204 Open source projects that are alternatives of or similar to Dswarm Backoffice Web

Beneath is a serverless real-time data platform ⚡️

M-Lab ingestion pipeline

基于web版kettle开发的一套分布式综合调度,管理,ETL开发的用户专业版B/S架构工具

Odoo Integration Addons

Enterprise Grade Single-Step Streaming Data Infrastructure Setup. (Under Development)

AIStore: scalable storage for AI applications

Addax is an open source universal ETL tool that supports most of those RDBMS and NoSQLs on the planet, helping you transfer data from any one place to another.

🔮 Transform, query, and download geospatial data on the web.

The Taxonomy for ETL Automation Metadata (TEAM) is a metadata management tool for data warehouse automation. It is part of the ecosystem for data warehouse automation, alongside the Virtual Data Warehouse pattern manager and the generic schema for Data Warehouse Automation.

ETL Library for Machine Learning - data pipelines, data munging and wrangling

Tool and library to convert ETW logs to JSON files

A lightweight data processing framework for Apache Spark

Power of appbase.io via CLI, with nifty imports from your favorite data sources

dbd is a database prototyping tool that enables data analysts and engineers to quickly load and transform data in SQL databases.

Data ETL & Analysis on the dataset 'Baby Names from Social Security Card Applications - National Data'.

Python library for building Pangeo Forge recipes.

A simplified, lightweight ETL Framework based on Apache Spark

OpenRefine is a free, open source power tool for working with messy data and improving it. This repository contains Dockerbuild files for automated builds.

a go daemon that syncs MongoDB to Elasticsearch in realtime

ETL for the SPDR ETF holdings XLS documents

An orchestration platform for the development, production, and observation of data assets.

Data transformation framework for LinkML data models

SmartCode = IDataSource -> IBuildTask -> IOutput => Build Everything!!!

Generate beautiful documentation for your data pipelines in markdown format

A SQL-like language for performing ETL transformations.

Basin is a visual programming editor for building Spark and PySpark pipelines. Easily build, debug, and deploy complex ETL pipelines from your browser

A Kafka Connect source connector that generates data for tests

The premier open source Data Quality solution

Move your messages from MQTT to Apache Kafka in real-time 🚀

A lightweight stream processing library for Go

Example of an ETL Pipeline using Airflow

ETL Framework for .NET / c# (Parser / Writer for CSV, Flat, Xml, JSON, Key-Value, Parquet, Yaml, Avro formatted files)

C++ implementation of CAN ISO 15765-2 also known as CAN ISO transport protocol. CPP CAN isotp.

This repository is a getting started guide to Singer.

ELT Code for your Data Warehouse

WeDataSphere is a financial level one-stop open-source suitcase for big data platforms. Currently the source code of Scriptis and Linkis has already been released to the open-source community. WeDataSphere, Big Data Made Easy!

Virtual Machine for Desktop Search with Open Semantic Search

A hackable data integration & analysis tool to enable non technical users to edit data processing jobs and visualise data on demand.

GAMECHANGER aspires to be the Department’s trusted solution for evidence-based, data-driven decision-making across the universe of DoD requirements

Dataform is a framework for managing SQL based data operations in BigQuery, Snowflake, and Redshift

Python3 lib and cli for operating a Cardano Passive Node and using the API's. (PRE-ALPHA)

Monitoring tool to measure flow throughput of data sources and processing components that are part of Data Ingestion and ETL pipelines.

Multi-core processing of 'Gameday' data from Major League Baseball Advanced Media. Additional tools to parallelize large data sets and write them to a database.

An extensible Java framework for building XML and non-XML streaming applications

The OpenRefine Python Client from Paul Makepeace provides a library for communicating with an OpenRefine server. This fork extends the command line interface (CLI) and is distributed as a convenient one-file-executable (Windows, Linux, Mac). It is also available via Docker Hub, PyPI and Binder.

A serverless cluster computing system for the Go programming language

Python ETL(Extract-Transform-Load) tool / Data migration tool

Fancy stream processing made operationally mundane

ElasticSearch to PostgreSQL loader

React components to build CSV files on the fly basing on Array/literal object of data

Astro allows rapid and clean development of {Extract, Load, Transform} workflows using Python and SQL, powered by Apache Airflow.

A python package to create a database on the platform using our moj data warehousing framework

为DataX(https://github.com/alibaba/DataX) 提供远程多语言调用（ThriftServer，HttpServer） 分布式运行（DataX on YARN） 功能

Extract, Transform, Load: Any SQL Database in 4 lines of Code.

Monitoring tool to measure flow throughput of data sources and processing components that are part of Data Ingestion and ETL pipelines.

🐟 A streaming ETL for fish

Example project implementing best practices for PySpark ETL jobs and applications.

Logical Replication extension for PostgreSQL 13, 12, 11, 10, 9.6, 9.5, 9.4 (Postgres), providing much faster replication than Slony, Bucardo or Londiste, as well as cross-version upgrades.

A Go native tabular data extraction package. Currently supports .xls, .xlsx, .csv, .tsv formats.