Top 18 dataops open source projects

Kafka Docker for development. Kafka, Zookeeper, Schema Registry, Kafka-Connect, Landoop Tools, 20+ connectors

Firehose is an extensible, no-code, and cloud-native service to load real-time streaming data from Kafka to data stores, data lakes, and analytical storage systems.

Beneath is a serverless real-time data platform ⚡️

Metadata storage service

DataOps framework for Machine Learning projects.

This repository is home to the original helm charts for products throughout the open data platform ecosystem.

Lenses.io CLI (command-line interface)

Rivery CLI

A library for managing, validating, summarizing, and visualizing data.

Love your Data. Love the Environment. Love VULKИ.

Shield is a role-based cloud-native user management system, identity & access proxy, and authorization server for your applications and API endpoints.

Versatile Data Kit (VDK) is an open source framework that enables anybody with basic SQL or Python knowledge to create their own data pipelines.

Build DataOps platform with Apache Airflow and dbt on AWS

Siren provides an easy-to-use universal alert, notification, channels management framework for the entire observability infrastructure.

Polyaxon Core Client & CLI to streamline MLOps

Guardian is a tool for extensible and universal data access with automated access workflows and security controls across data stores, analytical systems, and cloud products.

Dagger is an easy-to-use, configuration over code, cloud-native framework built on top of Apache Flink for stateful processing of real-time streaming data.

Raccoon is a high-throughput, low-latency service to collect events in real-time from your web, mobile apps, and services using multiple network protocols.