1283 Open source projects that are alternatives of or similar to Ozone

CORTX Community Object Storage is 100% open source object storage uniquely optimized for mass capacity storage devices.

MooseFS – Open Source, Petabyte, Fault-Tolerant, Highly Performing, Scalable Network Distributed File System (Software-Defined Storage)

Pluggable foundation blocks for building distributed apps.

Kafka Connect FileSystem Connector

Apache Tez

Highly available Prometheus setup with long term storage capabilities. A CNCF Incubating project.

An application-oriented unified storage layer for Golang.

Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)

A static file deployment tool that supports multiple platforms./ 一个支持多家云厂商的静态文件部署工具

Cloud-enabled backup and restore tool for Apache Cassandra

A @rclone served WebDAV server with @minio as the s3 storage backend docker example

S4 is 100% S3 compatible storage, accessed through Tor and distributed using IPFS.

JuiceFS is a distributed POSIX file system built on top of Redis and S3.

A Ceph Object Storage Admin SDK / Client Library for Java ✨🍰✨

Example end to end data engineering project.

Read and write Neuroglancer datasets programmatically.

NooBaa is a Dynamic Data Gateway for cloud-native, hybrid and multi cloud environments ☁️🚀

MinIO Client is a replacement for ls, cp, mkdir, diff and rsync commands for filesystems and object storage.

Abstract file storage and upload plugin for CakePHP. Write to local disk, FTP, S3, Dropbox and more through a single interface. It's not just yet another uploader but a complete storage solution.

Amazon S3 Find and Forget is a solution to handle data erasure requests from data lakes stored on Amazon S3, for example, pursuant to the European General Data Protection Regulation (GDPR)

A high-performance, scalable and efficient ShuffleManager plugin for Apache Spark, utilizing UCX communication layer

Service for automatically managing and cleaning up unreferenced data

A tool for provisioning and managing Apache Hadoop clusters in the cloud. Cloudbreak, as part of the Hortonworks Data Platform, makes it easy to provision, configure and elastically grow HDP clusters on cloud infrastructure. Cloudbreak can be used to provision Hadoop across cloud infrastructure providers including AWS, Azure, GCP and OpenStack.

A vendor-neutral storage library for Golang: Write once, run on every storage service.

OLAP and ETL of Big Data

Less3 is an S3-compatible object storage server that runs on your laptop, servers, just about anywhere!

File Attachment toolkit for Ruby applications

High Performance, Kubernetes Native Object Storage

Parallel S3 and local filesystem execution tool.

📎 Flexible file upload and attachment library for Elixir

Simple solution to keep a independent S3 storages in sync

This module creates an S3 bucket suitable for receiving logs from other AWS services such as S3, CloudFront, and CloudTrail

kafka-connect-s3 : Ingest data from Kafka to Object Stores(s3)

Storage and image processing server written in Go

An AWS S3 storage adapter for Ghost

HTTP response caching for Koa. Supports Redis, in-memory store, and more!

Pin, Discover and Share Resources

🍎 macOS Electron+React App for uploading files to S3 directly from Status Bar

Ruby server for tus resumable upload protocol

Cloud Explorer

Information Inference Service of the OpenAIRE system

The Infinit policy-based software-defined storage platform.

rastercube is a python library for big data analysis of georeferenced time series data (e.g. MODIS NDVI)

BlobHelper is a common, consistent storage interface for Microsoft Azure, Amazon S3, Komodo, Kvpbase, and local filesystem written in C#.

☁️ Flexible and Fluent framework-agnostic driver based system to manage storage in Node.js

A curated list of storage open source tools. Backups, redundancy, sharing, distribution, encryption, etc.

clusterdock is a framework for creating Docker-based container clusters

Data cleaning, pre-processing, and Analytics on a million movies using Spark and Scala.

Go library providing common interface for working across multiple cloud storage backends

Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validation, Column extensions, SQL functions, and DataFrame transformations

Alluxio Python client - Access Any Data Source with Python

A collection of tutorials on Hadoop, MapReduce, Spark, Docker

简单的可视化湖州通话数据 假设数据量很大，没法用浏览器直接绘制热力图，把绘制热力图这一步骤放到线下计算分析。使用Apache Spark并行计算数据之后，再使用Apache Spark绘制热力图，然后用leafletjs加载OpenStreetMap图层和热力图图层，以达到良好的交互效果。现在使用Apache Spark实现绘制，可能是Apache Spark不擅长这方面的计算或者是我没有设计好算法，并行计算的速度比不上单机计算。Apache Spark绘制热力图和计算代码在这 https://github.com/yuanzhaokang/ParallelizeHeatmap.git .

Samples to the Oracle Big Data Lite VM

A complete (distributed) BigData stack, running in containers

RDMA accelerated, high-performance, scalable and efficient ShuffleManager plugin for Apache Spark

EdgeFS - decentralized, scalable data fabric platform for Edge/IoT Computing and Kubernetes apps

Deploy a secured, clustered, auto-scaling NiFi service in AWS.

Mapreduce project by Hadoop, Nutch, AWS EMR, Pig, Tez, Hive

The Archives Unleashed Toolkit is an open-source toolkit for analyzing web archives.