1326 Open source projects that are alternatives of or similar to hamilton

Mars is a tensor-based unified framework for large-scale data computation which scales numpy, pandas, scikit-learn and Python functions.

A tool for building feature stores.

Functionalities in Excel translated to Python

Data-frames & arrays on Clojure

Blog post on ETL pipelines with Airflow

EtlFlow is an ecosystem of functional libraries in Scala based on ZIO for writing various different tasks, jobs on GCP and AWS.

csvplus extends the standard Go encoding/csv package with fluent interface, lazy stream operations, indices and joins.

Pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).

Clean APIs for data cleaning. Python implementation of R package Janitor

SADDLE: Scala Data Library

www.vixtract.ru

Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validation, Column extensions, SQL functions, and DataFrame transformations

Python Client and Toolkit for DataFrames, Big Data, Machine Learning and ETL in Elasticsearch

Data ETL & Analysis on the global and Mexican datasets of the COVID-19 pandemic.

A schema-aware Scala library for data transformation

Data ETL & Analysis on the dataset 'Baby Names from Social Security Card Applications - National Data'.

DIRECT, the Data Integration Run-time Execution Control Tool, is a data logistics framework that can be used to monitor, log, audit and control data integration / ETL processes.

Clean APIs for data cleaning. Python implementation of R package Janitor

Apache-Spark based Data Flow(ETL) Framework which supports multiple read, write destinations of different types and also support multiple categories of transformation rules.

Real-Time Event Streaming & Change Data Capture

Simplify your ETL processes with these hands-on data sanitation tips, tricks, and best practices

Example of an ETL Pipeline using Airflow

A python package to create a database on the platform using our moj data warehousing framework

ETL Framework for .NET / c# (Parser / Writer for CSV, Flat, Xml, JSON, Key-Value, Parquet, Yaml, Avro formatted files)

Python library for building Pangeo Forge recipes.

Fancy stream processing made operationally mundane

Extract, Transform, Load: Any SQL Database in 4 lines of Code.

DatScan is an initiative to build an open-source CMS that will have the capability to solve any problem using data Analysis just with the help of various modules and a vast standardized module library

Beneath is a serverless real-time data platform ⚡️

A SQL-like language for performing ETL transformations.

ELT Code for your Data Warehouse

A simplified, lightweight ETL Framework based on Apache Spark

Dataform is a framework for managing SQL based data operations in BigQuery, Snowflake, and Redshift

locopy: Loading/Unloading to Redshift and Snowflake using Python.

Stetl, Streaming ETL, is a lightweight geospatial processing and ETL framework written in Python.

python ETL framework

This repository is a getting started guide to Singer.

A simple Spark-powered ETL framework that just works 🍺

Data processing and modelling framework for automating tasks (incl. Python & SQL transformations).

Repository for the projects needed to complete the Data Analyst Nanodegree.

Run Airflow in AWS ECS(Elastic Container Service) using Fargate tasks

一款基于kettle的数据处理web调度控制平台，支持文档资源库和数据库资源库，通过web平台控制kettle数据转换，可作为中间件集成到现有系统中

Python ETL(Extract-Transform-Load) tool / Data migration tool

Example project implementing best practices for PySpark ETL jobs and applications.

(Spatial) data harmonisation with hale studio (formerly HUMBOLDT Alignment Editor)

Configurable Extract, Transform, and Load

A visual ETL development and debugging tool for big data

Enterprise-grade, production-hardened, serverless data lake on AWS

A lightweight ETL (extract, transform, load) library and data integration toolbox for .NET.

Bender - Serverless ETL Framework

Example DAGs using hooks and operators from Airflow Plugins

A client for connecting and running DDLs on hive metastore.

Engezny is a python package that quickly generates all possible charts from your dataframe and saves them for you, and engezny is only supporting now uni-parameter visualization using the pie, bar and barh visualizations.

Airbyte is an open-source EL(T) platform that helps you replicate your data in your warehouses, lakes and databases.

A model-driven dynamically-configurable framework to acquire data from external sources and save it to your database.

[READ-ONLY] PHP - ETL (Extract Transform Load) data processing library

datascienv is package that helps you to setup your environment in single line of code with all dependency and it is also include pyforest that provide single line of import all required ml libraries

seatunnel plugin developing examples.

Powerful RDF Knowledge Graph Generation with [R2]RML Mappings

BETL. Meta data driven ETL generation using T-SQL