SeaweedfsSeaweedFS is a fast distributed storage system for blobs, objects, files, and data lake, for billions of files! Blob store has O(1) disk seek, cloud tiering. Filer supports Cloud Drive, cross-DC active-active replication, Kubernetes, POSIX FUSE mount, S3 API, S3 Gateway, Hadoop, WebDAV, encryption, Erasure Coding.
Stars: ✭ 13,380 (+829.81%)
awesome-storageA curated list of storage open source tools. Backups, redundancy, sharing, distribution, encryption, etc.
Stars: ✭ 324 (-77.48%)
CortxCORTX Community Object Storage is 100% open source object storage uniquely optimized for mass capacity storage devices.
Stars: ✭ 426 (-70.4%)
Less3Less3 is an S3-compatible object storage server that runs on your laptop, servers, just about anywhere!
Stars: ✭ 16 (-98.89%)
distkvDistributed KV Storage System based on Raft and RocksDB, can be use to store small files, like images.
Stars: ✭ 50 (-96.53%)
unfs3UNFS3 is a user-space implementation of the NFSv3 server specification.
Stars: ✭ 74 (-94.86%)
DatashimA kubernetes based framework for hassle free handling of datasets
Stars: ✭ 83 (-94.23%)
MiddlewareTrueNAS CORE/Enterprise/SCALE Middleware Git Repository
Stars: ✭ 1,851 (+28.63%)
cubefsCubeFS is a cloud native distributed storage platform.
Stars: ✭ 3,062 (+112.79%)
react-native-appsync-s3React Native app for image uploads to S3 and storing their records in Amazon DynamoDB using AWS Amplify and AppSync SDK
Stars: ✭ 18 (-98.75%)
terraform-aws-efs-backupTerraform module designed to easily backup EFS filesystems to S3 using DataPipeline
Stars: ✭ 40 (-97.22%)
ChubaofsChubaoFS (abbrev. CBFS) is a cloud native distributed file system and object store.
Stars: ✭ 2,482 (+72.48%)
puppet-nfsInstalls and configures NFS server and clients
Stars: ✭ 14 (-99.03%)
docker-nfs4Simple containerized NFS v4 server running on Alpine Linux
Stars: ✭ 19 (-98.68%)
Arc📎 Flexible file upload and attachment library for Elixir
Stars: ✭ 1,087 (-24.46%)
Walrus🔥 Fast, Secure and Reliable System Backup, Set up in Minutes.
Stars: ✭ 197 (-86.31%)
terraform-aws-s3Terraform module to create default S3 bucket with logging and encryption type specific features.
Stars: ✭ 22 (-98.47%)
s3cliCommand line tool for S3
Stars: ✭ 21 (-98.54%)
jupyterhub-deploy-swarmA DockerSwarm Jupyterhub setup, which uses a NFS Server running in a Docker Container for persistent storage
Stars: ✭ 19 (-98.68%)
Aws.s3Amazon Simple Storage Service (S3) API Client
Stars: ✭ 302 (-79.01%)
EdgefsEdgeFS - decentralized, scalable data fabric platform for Edge/IoT Computing and Kubernetes apps
Stars: ✭ 358 (-75.12%)
DepotToolkit for storing files and attachments in web applications
Stars: ✭ 125 (-91.31%)
InfinitThe Infinit policy-based software-defined storage platform.
Stars: ✭ 363 (-74.77%)
TiledbThe Universal Storage Engine
Stars: ✭ 1,072 (-25.5%)
Vagrant Nfs guestVagrant plugin to allow the guest to export a mount and the host to mount it.
Stars: ✭ 92 (-93.61%)
AkubraSimple solution to keep a independent S3 storages in sync
Stars: ✭ 79 (-94.51%)
SfsThe distributed object storage server used by PitchPoint Solutions to securely store billions of large and small files using minimal resources. Object data is stored in replicated volumes implemented like Facebooks Haystack Object Store. Object metadata which essentially maps an object name to a volume position is stored in an elasticsearch index.
Stars: ✭ 78 (-94.58%)
Confetti🎉 A tool to help creating and deploying static sites with AWS
Stars: ✭ 96 (-93.33%)
NeardbSimple document db made for infinitely scalable globally distributed reads.
Stars: ✭ 92 (-93.61%)
Tiledb PyPython interface to the TileDB storage manager
Stars: ✭ 78 (-94.58%)
Security Camera🔦 Motion detecting security camera using a raspberry pi, webcam, and slack
Stars: ✭ 76 (-94.72%)
S3 Beam🚀 direct-to-S3 uploading using ClojureScript
Stars: ✭ 91 (-93.68%)
Awesome Sec S3A collection of awesome AWS S3 tools that collects and enumerates exposed S3 buckets
Stars: ✭ 76 (-94.72%)
Kertish DfsKertish-dfs is a simple distributed storage platform, implements file storage on a single distributed computer cluster, and provides interfaces for file/folder handling. Kertish-dfs aims primarily for completely distributed operation without a single point of failure, scalable to the exabyte level.
Stars: ✭ 74 (-94.86%)
Nestjs Multer Extended💪 Extended MulterModule for NestJS with flexible S3 upload and helpful features
Stars: ✭ 99 (-93.12%)
Streamxkafka-connect-s3 : Ingest data from Kafka to Object Stores(s3)
Stars: ✭ 96 (-93.33%)
Awesome AwsA curated list of awesome Amazon Web Services (AWS) libraries, open source repos, guides, blogs, and other resources. Featuring the Fiery Meter of AWSome.
Stars: ✭ 9,895 (+587.63%)
Locopylocopy: Loading/Unloading to Redshift and Snowflake using Python.
Stars: ✭ 73 (-94.93%)
BucketlistAmazon S3 bucket spelunking!
Stars: ✭ 72 (-95%)
Sci PypeA Machine Learning API with native redis caching and export + import using S3. Analyze entire datasets using an API for building, training, testing, analyzing, extracting, importing, and archiving. This repository can run from a docker container or from the repository.
Stars: ✭ 90 (-93.75%)
CloudserverZenko CloudServer, an open-source Node.js implementation of the Amazon S3 protocol on the front-end and backend storage capabilities to multiple clouds, including Azure and Google.
Stars: ✭ 1,167 (-18.9%)
Aws InventoryPython script for AWS resources inventory (cheaper than AWS Config)
Stars: ✭ 69 (-95.21%)
KevK.E.V. (Keys, Extras, and Values) is a Python ORM for key-value stores based on Valley. Currently supported backends are Redis, S3, and a S3/Redis hybrid backend. Based on Valley.
Stars: ✭ 95 (-93.4%)
ObjstoreA Multi-Master Distributed Caching Layer for Amazon S3.
Stars: ✭ 69 (-95.21%)
Cloud Security AuditA command line security audit tool for Amazon Web Services
Stars: ✭ 68 (-95.27%)
StorjOngoing Storj v3 development. Decentralized cloud object storage that is affordable, easy to use, private, and secure.
Stars: ✭ 1,278 (-11.19%)
AntennaPainless iOS over-the-air enterprise distribution
Stars: ✭ 67 (-95.34%)
AwsSwift wrapper around AWS API
Stars: ✭ 67 (-95.34%)
S3updateEnable your Golang applications to self update with S3
Stars: ✭ 101 (-92.98%)
Splits Ioa speedrunning data store, analysis engine, and racing platform
Stars: ✭ 99 (-93.12%)
S3 To Lambda PatternsExample applications for the S3-to-Lambda patterns series in the AWS Compute Blog and learning path. Questions? @jbesw.
Stars: ✭ 95 (-93.4%)
Dropdot☁️ Direct Upload to Amazon S3 With CORS demo. Built with Node/Express
Stars: ✭ 87 (-93.95%)