blockchain-etl-streamingStreaming Ethereum and Bitcoin blockchain data to Google Pub/Sub or Postgres in Kubernetes
Stars: ✭ 57 (+3.64%)
Mutual labels: etl, apache-beam
ChoetlETL Framework for .NET / c# (Parser / Writer for CSV, Flat, Xml, JSON, Key-Value, Parquet, Yaml, Avro formatted files)
Stars: ✭ 372 (+576.36%)
Mutual labels: etl, parquet
DaFlowApache-Spark based Data Flow(ETL) Framework which supports multiple read, write destinations of different types and also support multiple categories of transformation rules.
Stars: ✭ 24 (-56.36%)
Mutual labels: etl, parquet
Eel SdkBig Data Toolkit for the JVM
Stars: ✭ 140 (+154.55%)
Mutual labels: etl, parquet
dbddbd is a database prototyping tool that enables data analysts and engineers to quickly load and transform data in SQL databases.
Stars: ✭ 30 (-45.45%)
Mutual labels: etl, parquet
id3cData logistics system enabling real-time pathogen surveillance. Built for the Seattle Flu Study.
Stars: ✭ 21 (-61.82%)
Mutual labels: etl, fhir
Etl2pcapngUtility that converts an .etl file containing a Windows network packet capture into .pcapng format.
Stars: ✭ 228 (+314.55%)
Mutual labels: etl
Bitcoin EtlETL scripts for Bitcoin, Litecoin, Dash, Zcash, Doge, Bitcoin Cash. Available in Google BigQuery https://goo.gl/oY5BCQ
Stars: ✭ 174 (+216.36%)
Mutual labels: etl
Linq2dbLinq to database provider.
Stars: ✭ 2,211 (+3920%)
Mutual labels: etl
vixtractwww.vixtract.ru
Stars: ✭ 40 (-27.27%)
Mutual labels: etl
Aws Etl OrchestratorA serverless architecture for orchestrating ETL jobs in arbitrarily-complex workflows using AWS Step Functions and AWS Lambda.
Stars: ✭ 245 (+345.45%)
Mutual labels: etl
Bulk WriterProvides guidance for fast ETL jobs, an IDataReader implementation for SqlBulkCopy (or the MySql or Oracle equivalents) that wraps an IEnumerable, and libraries for mapping entites to table columns.
Stars: ✭ 210 (+281.82%)
Mutual labels: etl
MetlMetl is a simple, web-based integration platform that allows for several different styles of data integration including messaging, file based Extract/Transform/Load (ETL), and remote procedure invocation via Web Services. Read more at www.jumpmind.com/products/metl/overview
Stars: ✭ 185 (+236.36%)
Mutual labels: etl
StoragetapperStorageTapper is a scalable realtime MySQL change data streaming, logical backup and logical replication service
Stars: ✭ 232 (+321.82%)
Mutual labels: etl
GrafterLinked Data & RDF Manufacturing Tools in Clojure
Stars: ✭ 174 (+216.36%)
Mutual labels: etl
BenderBender - Serverless ETL Framework
Stars: ✭ 171 (+210.91%)
Mutual labels: etl
EtlboxA lightweight ETL (extract, transform, load) library and data integration toolbox for .NET.
Stars: ✭ 203 (+269.09%)
Mutual labels: etl
Example Airflow DagsExample DAGs using hooks and operators from Airflow Plugins
Stars: ✭ 243 (+341.82%)
Mutual labels: etl