407 Open source projects that are alternatives of or similar to gallia-core

A scalable general purpose micro-framework for defining dataflows. You can use it to create dataframes, numpy matrices, python objects, ML models, etc.

This is a project based on the FIFA World Cup 2019 and Analyzes the Performance and Efficiency of Teams, Players, Countries and other related things using Data Analysis and Data Visualizations

A tool for building feature stores.

⚙️ Schedule notebooks, run them like APIs, expose securely your assets: Jupyter as a viable ⚡️ Production environment

An Elasticsearch client tailored to data science workflows.

Blog post on ETL pipelines with Airflow

Python library for building Pangeo Forge recipes.

Example project implementing best practices for PySpark ETL jobs and applications.

Pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).

Fancy stream processing made operationally mundane

Versatile Data Kit (VDK) is an open source framework that enables anybody with basic SQL or Python knowledge to create their own data pipelines.

An Extensible Suite of High-Performance and Low-Dependency Packages for Statistical Computing and Data Manipulation in R

Streaming Ethereum and Bitcoin blockchain data to Google Pub/Sub or Postgres in Kubernetes

Data processing and modelling framework for automating tasks (incl. Python & SQL transformations).

Enterprise-grade, production-hardened, serverless data lake on AWS

Beneath is a serverless real-time data platform ⚡️

ELT Code for your Data Warehouse

Feature Store for Machine Learning

Scalable identity resolution, entity resolution, data mastering and deduplication using ML

Example of an ETL Pipeline using Airflow

A python package to create a database on the platform using our moj data warehousing framework

A simple Spark-powered ETL framework that just works 🍺

Dataform is a framework for managing SQL based data operations in BigQuery, Snowflake, and Redshift

A client for connecting and running DDLs on hive metastore.

[READ-ONLY] PHP - ETL (Extract Transform Load) data processing library

Airbyte is an open-source EL(T) platform that helps you replicate your data in your warehouses, lakes and databases.

Powerful RDF Knowledge Graph Generation with [R2]RML Mappings

ETL (extract, transform and load) tools for ingesting Polygon blockchain data to Google BigQuery and Pub/Sub

🔄 Simple tool for ETL. From SQL to Redis.

CubETL - Framework and tool for data ETL (Extract, Transform and Load) in Python (PERSONAL PROJECT / SELDOM MAINTAINED)

Implementation of feature engineering from Feature engineering strategies for credit card fraud

Code relating to scraping public police data.

Apache-Spark based Data Flow(ETL) Framework which supports multiple read, write destinations of different types and also support multiple categories of transformation rules.

数据质量控制系统

ETH PhD Program course

A Pachyderm deep learning tutorial for conference workshops

This repository consist of a 50-day program. All the statistics required for the complete understanding of data science will be uploaded in this repository.

ETL for the NASDAQ symbol file

Automatic feature engineering using deep learning and Bayesian inference using TensorFlow.

Package for Heart Rate Variability analysis in Python

A data transformation package for deep learning with Autonomio, Keras and TensorFlow.

Clean APIs for data cleaning. Python implementation of R package Janitor

Short programming tutorials pertaining to data analysis.

Paraphrase question identification using Feature Fusion Network (FFN).

Data ETL & Analysis on the global and Mexican datasets of the COVID-19 pandemic.

Viewflow is an Airflow-based framework that allows data scientists to create data models without writing Airflow code.

The Move to Islandora Kit is an extensible PHP command-line tool for converting source content and metadata into packages suitable for importing into Islandora (or other digital repository and preservations systems).

一款基于kettle的数据处理web调度控制平台，支持文档资源库和数据库资源库，通过web平台控制kettle数据转换，可作为中间件集成到现有系统中

This package can be used for dominance analysis or Shapley Value Regression for finding relative importance of predictors on given dataset. This library can be used for key driver analysis or marginal resource allocation models.

EtlFlow is an ecosystem of functional libraries in Scala based on ZIO for writing various different tasks, jobs on GCP and AWS.

csvplus extends the standard Go encoding/csv package with fluent interface, lazy stream operations, indices and joins.

ETL jobs for Firefox Telemetry

网站点击流离线日志分析

In-memory Java DataFrame library

Configurable data bridge for permanent ETL jobs

Data transformation toolkit

Create and work with nested services.

CVparser is software for parsing or extracting data out of CV/resumes.

Flexible tables with ordered indices

dbt-sugar is a CLI tool that allows users of dbt to have fun and ease performing actions around dbt models