407 Open source projects that are alternatives of or similar to gallia-core

Apache Superset is a Data Visualization and Data Exploration Platform

Example end to end data engineering project.

A cross-platform command line tool for parallelised content extraction and analysis.

Waimak is an open-source framework that makes it easier to create complex data flows in Apache Spark.

ETL for the NASDAQ symbol file

dbt adapter for SQL Server and Azure SQL

Metl is a simple, web-based integration platform that allows for several different styles of data integration including messaging, file based Extract/Transform/Load (ETL), and remote procedure invocation via Web Services. Read more at www.jumpmind.com/products/metl/overview

Python client for using Prefect Cloud with Saturn Cloud

The easiest way to automate your data

Linked Data & RDF Manufacturing Tools in Clojure

Data validation and organization of metadata for data frames and database tables

Automatic feature engineering using deep learning and Bayesian inference using TensorFlow.

Few projects related to Data Engineering including Data Modeling, Infrastructure setup on cloud, Data Warehousing and Data Lake development.

Bender - Serverless ETL Framework

Turn complex requirements to workflows without leaving the comfort of your technology stack.

📝 A compilation of everything that I learn; Computer Science, Software Development, Engineering, Math, and Coding in General. Read the rendered results here ->

Change CRC checksums of your files.

Odoo Integration Addons

dbd is a database prototyping tool that enables data analysts and engineers to quickly load and transform data in SQL databases.

The Data Engineering Cookbook

Python based Open Source ETL tools for file crawling, document processing (text extraction, OCR), content analysis (Entity Extraction & Named Entity Recognition) & data enrichment (annotation) pipelines & ingestor to Solr or Elastic search index & linked data graph database

Open Source Feature Flagging and A/B Testing Platform

A bioinformatics API and web-app to integrate multi-omics datasets & interface with public databases.

Summary of my projects on kaggle

An example mini data warehouse for python project stats, template for new projects

This repo contains commands that data engineers use in day to day work.

Short programming tutorials pertaining to data analysis.

Personal Data Engineering Projects

omniparser: a native Golang ETL streaming parser and transform library for CSV, JSON, XML, EDI, text, etc.

The Cyber Swiss Army Knife - a web app for encryption, encoding, compression and data analysis

Live import all your Google Sheets to your data warehouse

Automated Anki flashcard creation and extraction to/from Csv

Big Data Toolkit for the JVM

List of resources for learning R

Data ETL & Analysis on the global and Mexican datasets of the COVID-19 pandemic.

Aplus Framework Database Library

基于spring boot通过java代码调用kette

Feature engineering is the process of using domain knowledge to extract features from raw data via data mining techniques. These features can be used to improve the performance of machine learning algorithms. Feature engineering can be considered as applied machine learning itself.

A simplified version of featuretools for Spark

An intuitive library to extract features from time series

Mass processing data with a complete ETL for .net developers

Viewflow is an Airflow-based framework that allows data scientists to create data models without writing Airflow code.

Real estate dagster pipeline

DIRECT, the Data Integration Run-time Execution Control Tool, is a data logistics framework that can be used to monitor, log, audit and control data integration / ETL processes.

C++ implementation of CAN ISO 15765-2 also known as CAN ISO transport protocol. CPP CAN isotp.

汉字字符特征提取器 (featurizer)，提取汉字的特征（发音特征、字形特征）用做深度学习的特征 ｜ A Chinese character feature extractor, which extracts the features of Chinese characters (pronunciation features, glyph features) as features for deep learning

Configurable Extract, Transform, and Load

A practical feature engineering handbook

Yet Another ETL in PHP

TransmogrifAI (pronounced trăns-mŏgˈrə-fī) is an AutoML library for building modular, reusable, strongly typed machine learning workflows on Apache Spark with minimal hand-tuning

This is a comprehensive ML techniques with python: Define the Problem- Specify Inputs & Outputs- Data Collection- Exploratory data analysis -Data Preprocessing- Model Design- Training- Evaluation

This package can be used for dominance analysis or Shapley Value Regression for finding relative importance of predictors on given dataset. This library can be used for key driver analysis or marginal resource allocation models.

Data processing & ETL framework for Ruby

🏆DataCon大数据安全分析大赛，2019年方向二（恶意代码检测）冠军源码、2020年方向五（恶意代码分析）季军源码

ETL for OIC Options Chains

🇨🇳 MyDataHarbor是一个致力于解决任意数据源到任意数据源的分布式、高扩展性、高性能、事务级的数据同步中间件。帮助用户可靠、快速、稳定的对海量数据进行准实时增量同步或者定时全量同步，主要定位是为实时交易系统服务，亦可用于大数据的数据同步（ETL领域）。

A COBOL parser and Mainframe/EBCDIC data source for Apache Spark

This repository contains the code that extracts a table from an image and exports it to an Excel.

A minimalist (geospatial) ETL

Virtual Machine for Desktop Search with Open Semantic Search