479 Open source projects that are alternatives of or similar to Open Data Etl Utility Kit

Scalable identity resolution, entity resolution, data mastering and deduplication using ML

A resource to help federal employees write in plain language and comply with the Plain Writing Act of 2010

大数据采集,抽取平台

A Socrata Open Data API (SODA) client library for .NET

Data migration framework for Django that migrates legacy data into your new django app

ArcGIS Pro Add-in that assists in emergency management, local government and state government data aggregation workflows.

Sistema de auditoria da OPS

React components to build CSV files on the fly basing on Array/literal object of data

⚙️ Schedule notebooks, run them like APIs, expose securely your assets: Jupyter as a viable ⚡️ Production environment

Data Analysis Using Python: A Beginner’s Guide Featuring NYC Open Data

o diário oficial do século XXI

Open Definition source

Insight into the Dutch parliament

Display (real-time) public transport departures using Raspberry Pi and LED matrices

package for interacting with fisheries databases at openfisheries.org

🛠 Component code and tests for the Australian Government design system

BETL. Meta data driven ETL generation using T-SQL

🎤 Entretiens utilisateurs pour la compréhension des usages 🤓 réduction des frictions entre utilisateurs et données.

Unofficial Statistics Netherlands (CBS) opendata API client for Python

Open framework for calculating spatial urban sprawl indices and performing disaggregated population estimates using open data

A GovSpeak to English translator a.k.a. glossary of common government IT and procurement terms, abbreviations and acronyms (CGITPTAA)

Python library for building Pangeo Forge recipes.

A community-currated collection of tech resources, projects, and other things related for Birmingham, AL

The U.S. Web Design System helps the federal government build fast, accessible, mobile-friendly websites.

Idra - Open Data Federation Platform

Addax is an open source universal ETL tool that supports most of those RDBMS and NoSQLs on the planet, helping you transfer data from any one place to another.

Shell script to run OpenRefine in batch mode (import, transform, export). It orchestrates OpenRefine (server) and a python client that communicates with the OpenRefine API.

locopy: Loading/Unloading to Redshift and Snowflake using Python.

Public documentation and wiki for DoIT’s Digital team. Monorepo for new services.

A Transportation-Themed Hackathon hosted by the City of Austin and the UT Center for Transportation Research

ETL for the IEX Stocks API

Faster requests on Python 3

Repository for the code of the Open Energy Platform (OEP) website. The OEP provides an interface to the Open Energy Family

OpenRefine is a free, open source power tool for working with messy data and improving it. This repository contains Dockerbuild files for automated builds.

JDBC driver for Neo4j

List of JavaScript modules for Berlin & Brandenburg public transport.

Learn how to use PyCBC to analyze gravitational-wave data and do parameter inference.

M-Lab ingestion pipeline

Téléchargement des données sur le site de l'Insee

A lightweight stream processing library for Go

MySQL / MariaDB import for DTD feeds (fares, timetable and routeing)

ETL for the SPDR ETF holdings XLS documents

Gerador de DAGs no Airflow para fazer clipping do Diário Oficial da União.

Gather, curate, and feature stories of public servants and civic hackers using GitHub as part of their open government innovations

Python based Wikidata framework for easy dataframe extraction

Skin and customization for the French opendata portal based on udata. This project is not maintained anymore. Consider using https://github.com/etalab/udata-front as an alternative.

[READ-ONLY] PHP - ETL (Extract Transform Load) data processing library

Data ETL & Analysis on the dataset 'Baby Names from Social Security Card Applications - National Data'.

DataX 是异构数据广泛使用的离线数据同步工具/平台，实现包括 MySQL、Oracle、SqlServer、Postgre、HDFS、Hive、ADS、HBase、OTS、ODPS 等各种异构数据源之间高效的数据同步功能。

The tool takes the public through a series of questions to inform those who are concerned they may have contracted COVID-19.

Whole building non-residential hourly energy meter data from the Great Energy Predictor III competition

PHP ETL (Extract / Transform / Load) library with SOLID principles + almost no dependency.

The open-source IATI datastore for IATI data with RESTful web API providing XML, JSON, CSV output. It extracts and parses IATI XML files referenced in the IATI Registry and powered by Apache Solr.

Monitoring tool to measure flow throughput of data sources and processing components that are part of Data Ingestion and ETL pipelines.

Competency and Skills System

☁️ nodejs kafka connect connector for Google BigQuery

Public web scraping scripts for the University of Toronto.

R client for the CKAN API

LinkedPipes ETL is an RDF based, lightweight ETL tool

Série histórica dos dados sobre COVID-19, a partir de informações do Ministério da Saúde