1569 Open source projects that are alternatives of or similar to beneath

Versatile Data Kit (VDK) is an open source framework that enables anybody with basic SQL or Python knowledge to create their own data pipelines.

Rivery CLI

An orchestration platform for the development, production, and observation of data assets.

Dataform is a framework for managing SQL based data operations in BigQuery, Snowflake, and Redshift

Example of an ETL Pipeline using Airflow

Data processing and modelling framework for automating tasks (incl. Python & SQL transformations).

Enterprise-grade, production-hardened, serverless data lake on AWS

A Pachyderm deep learning tutorial for conference workshops

GitHub Analytics with Keen IO

ELT Code for your Data Warehouse

Example project implementing best practices for PySpark ETL jobs and applications.

A schema-aware Scala library for data transformation

Virtual Machine for Desktop Search with Open Semantic Search

Greenplum Database - Massively Parallel PostgreSQL for Analytics. An open-source massively parallel data platform for analytics, machine learning and AI.

Dataset format for AI. Build, manage, & visualize datasets for deep learning. Stream data real-time to PyTorch/TensorFlow & version-control it. https://activeloop.ai

DataOps framework for Machine Learning projects.

A hackable data integration & analysis tool to enable non technical users to edit data processing jobs and visualise data on demand.

Play detective on Reddit: Discover political disinformation campaigns, secret influencers and more

Pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).

A python library to push ethereum blockchain data into an sql database.

A tool for building feature stores.

Airbyte is an open-source EL(T) platform that helps you replicate your data in your warehouses, lakes and databases.

SQL-based streaming analytics platform at scale

.NET for Apache® Spark™ makes Apache Spark™ easily accessible to .NET developers.

A client for connecting and running DDLs on hive metastore.

Powerful RDF Knowledge Graph Generation with [R2]RML Mappings

Firehose is an extensible, no-code, and cloud-native service to load real-time streaming data from Kafka to data stores, data lakes, and analytical storage systems.

[READ-ONLY] PHP - ETL (Extract Transform Load) data processing library

ETL (extract, transform and load) tools for ingesting Polygon blockchain data to Google BigQuery and Pub/Sub

An Elasticsearch client tailored to data science workflows.

Streaming Ethereum and Bitcoin blockchain data to Google Pub/Sub or Postgres in Kubernetes

Always know what to expect from your data.

Feature Store for Machine Learning

Apache Superset is a Data Visualization and Data Exploration Platform

Live import all your Google Sheets to your data warehouse

Fancy stream processing made operationally mundane

A python package to create a database on the platform using our moj data warehousing framework

A library for managing, validating, summarizing, and visualizing data.

A simple Spark-powered ETL framework that just works 🍺

Personal Data Engineering Projects

The goal of this repository is to enable data scientists and ML engineers to develop data science use cases and making it ready for production use. This means focusing on the versioning, scalability, monitoring and engineering of the solution.

Polyaxon Core Client & CLI to streamline MLOps

Distributed "massively parallel" SQL query engine

📈 A small, fast chart for time series, lines, areas, ohlc & bars

Blog post on ETL pipelines with Airflow

Real Time Analytics and Data Pipelines based on Spark Streaming

Open Source Feature Flagging and A/B Testing Platform

A scalable general purpose micro-framework for defining dataflows. You can use it to create dataframes, numpy matrices, python objects, ML models, etc.

The practical use-cases of how to make your Machine Learning Pipelines robust and reliable using Apache Airflow.

Python library for building Pangeo Forge recipes.

Parse and generate m3u8 playlists for Apple HTTP Live Streaming (HLS) in Ruby.

Kubeflow pipelines built on top of Tensorflow TFX library

A light-weight android library that can be quickly integrated into any app to use analytics tools.

An end-to-end example of MLOps on Google Cloud using TensorFlow, TFX, and Vertex AI

OWN3D Pro OBS Plugin

Analysis with Covid-19 data

MailTrap has been renamed to Sendria. Please use Sendria now, MailTrap is abandoned. MailTrap is a SMTP server designed to run in your dev/test environment, that is designed to catch any email you or your application is sending, and display it in a web interface instead of sending to real world.

Pythonic DJI Ryze Tello Workbench

Flexible and efficient data processing engine and an evolution of the popular Scramjet Framework based on node.js. Our Transform Hub was designed specifically for data processing and has its own unique algorithms included.

🌈 Autonomous streaming audio ,serveronline internet radio is free streaming music for your listening pleasure, as well as news and announcements.