All Projects → thbar → Kiba

thbar / Kiba

Licence: other
Data processing & ETL framework for Ruby

Programming Languages

ruby
36898 projects - #4 most used programming language

Projects that are alternatives of or similar to Kiba

Mara Pipelines
A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow
Stars: ✭ 1,841 (+13.78%)
Mutual labels:  etl, data
Riko
A Python stream processing engine modeled after Yahoo! Pipes
Stars: ✭ 1,571 (-2.9%)
Mutual labels:  etl, data
Datacleaner
The premier open source Data Quality solution
Stars: ✭ 391 (-75.83%)
Mutual labels:  etl, data
Reddit Detective
Play detective on Reddit: Discover political disinformation campaigns, secret influencers and more
Stars: ✭ 129 (-92.03%)
Mutual labels:  etl, data
Airbyte
Airbyte is an open-source EL(T) platform that helps you replicate your data in your warehouses, lakes and databases.
Stars: ✭ 4,919 (+204.02%)
Mutual labels:  etl, data
Grafter
Linked Data & RDF Manufacturing Tools in Clojure
Stars: ✭ 174 (-89.25%)
Mutual labels:  etl, data
Locopy
locopy: Loading/Unloading to Redshift and Snowflake using Python.
Stars: ✭ 73 (-95.49%)
Mutual labels:  etl, data
Datx
DatX is an opinionated JS/TS data store. It features support for simple property definition, references to other models and first-class TypeScript support.
Stars: ✭ 111 (-93.14%)
Mutual labels:  data
Datax
DataX is an open source universal ETL tool that support Cassandra, ClickHouse, DBF, Hive, InfluxDB, Kudu, MySQL, Oracle, Presto(Trino), PostgreSQL, SQL Server
Stars: ✭ 116 (-92.83%)
Mutual labels:  etl
Mhworlddata
Generate a SQLite file from MHW data
Stars: ✭ 110 (-93.2%)
Mutual labels:  data
Caryon
🔖一款基于C++的OI/ACM比赛出题解题辅助工具⭐
Stars: ✭ 109 (-93.26%)
Mutual labels:  data
Repurrrsive
Recursive lists to use in teaching and examples, because there is no iris data for lists.
Stars: ✭ 112 (-93.08%)
Mutual labels:  data
Chartjs Plugin Dragdata
Draggable data points plugin for Chart.js
Stars: ✭ 116 (-92.83%)
Mutual labels:  data
Data Processing Agreements
Collection of Data Processing Agreement (DPA) and GDPR compliance resources
Stars: ✭ 110 (-93.2%)
Mutual labels:  data
Sentinel Crawler
Xenomorph Crawler, a Concise, Declarative and Observable Distributed Crawler(Node / Go / Java / Rust) For Web, RDB, OS, also can act as a Monitor(with Prometheus) or ETL for Infrastructure 💫 多语言执行器,分布式爬虫
Stars: ✭ 118 (-92.71%)
Mutual labels:  etl
Hass Data Detective
Explore and analyse your Home Assistant data
Stars: ✭ 109 (-93.26%)
Mutual labels:  data
Awesome Opendata Rus
Opendata resources in Russian / Открытые данные на русском языке
Stars: ✭ 121 (-92.52%)
Mutual labels:  data
Hearthstone Db
A JSON collection of all Hearthstone cards. Hearthstone database.
Stars: ✭ 117 (-92.77%)
Mutual labels:  data
Amazon S3 Find And Forget
Amazon S3 Find and Forget is a solution to handle data erasure requests from data lakes stored on Amazon S3, for example, pursuant to the European General Data Protection Regulation (GDPR)
Stars: ✭ 115 (-92.89%)
Mutual labels:  data
Just Dashboard
📊 📋 Dashboards using YAML or JSON files
Stars: ✭ 1,511 (-6.61%)
Mutual labels:  data

Kiba ETL

Gem Version Build Status Code Climate

Writing reliable, concise, well-tested & maintainable data-processing code is tricky.

Kiba lets you define and run such high-quality ETL (Extract-Transform-Load) jobs using Ruby.

Getting Started

Head over to the Wiki for up-to-date documentation.

If you need help, please ask your question with tag kiba-etl on StackOverflow so that other can benefit from your contribution! I monitor this specific tag and will reply to you.

Kiba Pro customers get priority private email support for any unforeseen issues and simple matters such as installation troubles. Our consulting services will also be prioritized to Kiba Pro subscribers. If you need any coaching on ETL & data pipeline implementation, please reach out via email so we can discuss how to help you out.

You can also check out the author blog and StackOverflow answers.

Supported Ruby versions

Kiba currently supports Ruby 2.5+, JRuby 9.2+ and TruffleRuby. See test matrix.

ETL consulting & commercial version

Consulting services: if your organization needs guidance on Kiba / ETL implementations, we provide consulting services. Contact at https://www.logeek.fr.

Kiba Pro: for vendor-backed ETL extensions, check out Kiba Pro.

License

Copyright (c) LoGeek SARL. Kiba is an Open Source project licensed under the terms of the LGPLv3 license. Please see http://www.gnu.org/licenses/lgpl-3.0.html for license text.

Contributing & Legal

(agreement below borrowed from Sidekiq Legal)

By submitting a Pull Request, you disavow any rights or claims to any changes submitted to the Kiba project and assign the copyright of those changes to LoGeek SARL.

If you cannot or do not want to reassign those rights (your employment contract for your employer may not allow this), you should not submit a PR. Open an issue and someone else can do the work.

This is a legal way of saying "If you submit a PR to us, that code becomes ours". 99.9% of the time that's what you intend anyways; we hope it doesn't scare you away from contributing.

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].