singer-io / Getting Started
This repository is a getting started guide to Singer.
Stars: ✭ 734
Programming Languages
python
139335 projects - #7 most used programming language
Projects that are alternatives of or similar to Getting Started
architect big data solutions with spark
code, labs and lectures for the course
Stars: ✭ 40 (-94.55%)
Mutual labels: etl, data-analysis
DataBridge.NET
Configurable data bridge for permanent ETL jobs
Stars: ✭ 16 (-97.82%)
Mutual labels: etl, etl-framework
etlflow
EtlFlow is an ecosystem of functional libraries in Scala based on ZIO for writing various different tasks, jobs on GCP and AWS.
Stars: ✭ 38 (-94.82%)
Mutual labels: etl, etl-framework
csvplus
csvplus extends the standard Go encoding/csv package with fluent interface, lazy stream operations, indices and joins.
Stars: ✭ 67 (-90.87%)
Mutual labels: etl, etl-framework
Metorikku
A simplified, lightweight ETL Framework based on Apache Spark
Stars: ✭ 361 (-50.82%)
Mutual labels: etl, etl-framework
OpenKettleWebUI
一款基于kettle的数据处理web调度控制平台，支持文档资源库和数据库资源库，通过web平台控制kettle数据转换，可作为中间件集成到现有系统中
Stars: ✭ 138 (-81.2%)
Mutual labels: etl, etl-framework
cubetl
CubETL - Framework and tool for data ETL (Extract, Transform and Load) in Python (PERSONAL PROJECT / SELDOM MAINTAINED)
Stars: ✭ 21 (-97.14%)
Mutual labels: etl, etl-framework
DIRECT
DIRECT, the Data Integration Run-time Execution Control Tool, is a data logistics framework that can be used to monitor, log, audit and control data integration / ETL processes.
Stars: ✭ 20 (-97.28%)
Mutual labels: etl, etl-framework
qwery
A SQL-like language for performing ETL transformations.
Stars: ✭ 28 (-96.19%)
Mutual labels: etl, etl-framework
redis-connect-dist
Real-Time Event Streaming & Change Data Capture
Stars: ✭ 21 (-97.14%)
Mutual labels: etl, etl-framework
datalake-etl-pipeline
Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validation, Column extensions, SQL functions, and DataFrame transformations
Stars: ✭ 39 (-94.69%)
Mutual labels: etl, etl-framework
Datacleaner
The premier open source Data Quality solution
Stars: ✭ 391 (-46.73%)
Mutual labels: data-analysis, etl
BETL-old
BETL. Meta data driven ETL generation using T-SQL
Stars: ✭ 17 (-97.68%)
Mutual labels: etl, etl-framework
hamilton
A scalable general purpose micro-framework for defining dataflows. You can use it to create dataframes, numpy matrices, python objects, ML models, etc.
Stars: ✭ 612 (-16.62%)
Mutual labels: etl, etl-framework
link-move
A model-driven dynamically-configurable framework to acquire data from external sources and save it to your database.
Stars: ✭ 32 (-95.64%)
Mutual labels: etl, etl-framework
DaFlow
Apache-Spark based Data Flow(ETL) Framework which supports multiple read, write destinations of different types and also support multiple categories of transformation rules.
Stars: ✭ 24 (-96.73%)
Mutual labels: etl, etl-framework
Data Making Guidelines
📘 Making Data, the DataMade Way
Stars: ✭ 248 (-66.21%)
Mutual labels: makefile, etl
Choetl
ETL Framework for .NET / c# (Parser / Writer for CSV, Flat, Xml, JSON, Key-Value, Parquet, Yaml, Avro formatted files)
Stars: ✭ 372 (-49.32%)
Mutual labels: etl, etl-framework
Singer
Singer is an open source standard for moving data between databases, web APIs, files, queues, and just about anything else you can think of. The Singer spec describes how data extraction scripts — called “Taps” — and data loading scripts — called “Targets” — should communicate using a standard JSON-based data format over stdout. By conforming to this spec, Taps and Targets can be used in any combination to move data from any source to any destination.
Join the Singer Slack channel to get help from members of the Singer community.
Docs
- Singer Specification
- Running and Developing Singer Taps and Targets
- Config and State
- Discovery Mode
- Sync Mode
- Best Practices for Building a Singer Tap
- FAQ
Copyright © 2018 Stitch
Note that the project description data, including the texts, logos, images, and/or trademarks,
for each open source project belongs to its rightful owner.
If you wish to add or remove any projects, please contact us at [email protected].