radioRedundant Array of Distributed Independent Objectstores in short RADIO performs synchronous mirroring, erasure coding across multiple object stores
Stars: ✭ 25 (-50.98%)
SeaweedfsSeaweedFS is a fast distributed storage system for blobs, objects, files, and data lake, for billions of files! Blob store has O(1) disk seek, cloud tiering. Filer supports Cloud Drive, cross-DC active-active replication, Kubernetes, POSIX FUSE mount, S3 API, S3 Gateway, Hadoop, WebDAV, encryption, Erasure Coding.
Stars: ✭ 13,380 (+26135.29%)
awesome-storageA curated list of storage open source tools. Backups, redundancy, sharing, distribution, encryption, etc.
Stars: ✭ 324 (+535.29%)
data-transfer-hubSeamless User Interface for replicating data into AWS.
Stars: ✭ 102 (+100%)
LitestreamStreaming replication for SQLite.
Stars: ✭ 3,795 (+7341.18%)
Wal EContinuous Archiving for Postgres
Stars: ✭ 3,313 (+6396.08%)
aws-pdf-textract-pipeline🔍 Data pipeline for crawling PDFs from the Web and transforming their contents into structured data using AWS textract. Built with AWS CDK + TypeScript
Stars: ✭ 141 (+176.47%)
krawlerA minimalist (geospatial) ETL
Stars: ✭ 51 (+0%)
itc.luaA Lua implementation of Interval Tree Clocks
Stars: ✭ 21 (-58.82%)
ReopenldapProduction-ready replacement for OpenLDAP with robust multi-master replication
Stars: ✭ 242 (+374.51%)
ndstorecode for storing neurodata images and image annotations
Stars: ✭ 39 (-23.53%)
graphchain⚡️ An efficient cache for the execution of dask graphs.
Stars: ✭ 63 (+23.53%)
backup-repositoryBackup storage for E2E GPG-encrypted files, with multi-user, quotas, versioning, using a object storage (S3/Min.io/GCS etc.) and deployed on Kubernetes or standalone.
Stars: ✭ 21 (-58.82%)
Flopnite Ue4A remake of the popular battle royale game, Fortnite, made in Unreal Engine 4 and integrated with Amazon GameLift
Stars: ✭ 250 (+390.2%)
Seamless database poolAdd support for master/slave database clusters in ActiveRecord to improve performance.
Stars: ✭ 222 (+335.29%)
qscamelqscamel is a command line tool to migrate data between different endpoint efficiently.
Stars: ✭ 34 (-33.33%)
SreeS3 client for human beings
Stars: ✭ 55 (+7.84%)
VastoA distributed key-value store. On Disk. Able to grow or shrink without service interruption.
Stars: ✭ 206 (+303.92%)
Amazonriveramazonriver 是一个将postgresql的实时数据同步到es或kafka的服务
Stars: ✭ 198 (+288.24%)
s3redirectTurn S3 into a URL redirect website using lambda and NO database!
Stars: ✭ 31 (-39.22%)
Mysql SandboxQuick and painless install of one or more MySQL servers in the same host.
Stars: ✭ 176 (+245.1%)
GobblinA distributed data integration framework that simplifies common aspects of big data integration such as data ingestion, replication, organization and lifecycle management for both streaming and batch data ecosystems.
Stars: ✭ 2,006 (+3833.33%)
s3bundlerARCHIVED - see https://aws.amazon.com/about-aws/whats-new/2019/04/Amazon-S3-Introduces-S3-Batch-Operations-for-Object-Management/ Amazon S3 Bundler downloads billions of small S3 objects, bundles them into archives, and uploads them back into S3.
Stars: ✭ 26 (-49.02%)
radiusdDistributed Radius-server to do authentication+accounting.
Stars: ✭ 50 (-1.96%)
mediasortUpload manager using Laravel's built-in Filesystem/Cloud Storage
Stars: ✭ 20 (-60.78%)
mindavA self-hosted file backup server which bridges WebDAV protocol with @minio written in @totoval. Webdav ❤️ Minio
Stars: ✭ 64 (+25.49%)
pg-bifrostPostgreSQL Logical Replication tool into Kinesis, S3 and RabbitMQ
Stars: ✭ 31 (-39.22%)
vrrmrough code for running consensus
Stars: ✭ 18 (-64.71%)
terraform-aws-s3Terraform module to create default S3 bucket with logging and encryption type specific features.
Stars: ✭ 22 (-56.86%)
ldbReplication of CRDTs
Stars: ✭ 37 (-27.45%)
backblazeBackblaze.Agent is a high-performance .NET Core implementation of the Backblaze B2 Cloud Storage API.
Stars: ✭ 32 (-37.25%)
Acid StateAdd ACID guarantees to any serializable Haskell data structure
Stars: ✭ 246 (+382.35%)
pglogreplPostgreSQL logical replication library for Go.
Stars: ✭ 150 (+194.12%)
s3-exampleSimple example using micro for uploading stuff to AWS S3.
Stars: ✭ 45 (-11.76%)
xyrQuery any data source using SQL, works with the local filesystem, s3, and more. It should be a very tiny and lightweight alternative to AWS Athena, Presto ... etc.
Stars: ✭ 58 (+13.73%)
LapidusStream your PostgreSQL, MySQL or MongoDB databases anywhere, fast.
Stars: ✭ 145 (+184.31%)
terraform-aws-s3-bucketTerraform module that creates an S3 bucket with an optional IAM user for external CI/CD systems
Stars: ✭ 138 (+170.59%)
Php Mysql ReplicationPure PHP Implementation of MySQL replication protocol. This allow you to receive event like insert, update, delete with their data and raw SQL queries.
Stars: ✭ 213 (+317.65%)
skbnCopy files and directories between Kubernetes and cloud storage
Stars: ✭ 68 (+33.33%)
SynchSync data from the other DB to ClickHouse(cluster)
Stars: ✭ 200 (+292.16%)
s3-concatConcat multiple files in s3
Stars: ✭ 35 (-31.37%)
HerddbA JVM-embeddable Distributed Database
Stars: ✭ 192 (+276.47%)
sls-photos-upload-serviceExample web app and serverless API for uploading photos and saving to S3 and DynamoDB
Stars: ✭ 50 (-1.96%)
MarsAsynchronous Block-Level Storage Replication
Stars: ✭ 168 (+229.41%)
smockinDynamic API, S3 & Mail mocking for web, mobile & microservice development.
Stars: ✭ 74 (+45.1%)
nestjs-storageNestjs file system / file storage module wrapping flydrive
Stars: ✭ 92 (+80.39%)
SanoidPolicy-driven snapshot management and replication tools. Using ZFS for underlying next-gen storage. (Btrfs support plans are shelved unless and until btrfs becomes reliable.) Primarily intended for Linux, but BSD use is supported and reasonably frequently tested.
Stars: ✭ 1,991 (+3803.92%)
SosSimple Object Storage (I wish I could call it Steve's Simple Storage, or S3 ;)
Stars: ✭ 129 (+152.94%)
Lealone极具创新的面向微服务和 OLTP/OLAP 场景的单机与分布式关系数据库
Stars: ✭ 1,802 (+3433.33%)
hubPublic reusable components for Polyaxon
Stars: ✭ 8 (-84.31%)
secure-mediaStore private media securely in WordPress.
Stars: ✭ 22 (-56.86%)
SpiegelScalable replication and change listening for CouchDB
Stars: ✭ 126 (+147.06%)
EnvoyA CouchDB proxy to enable replication of database subsets
Stars: ✭ 123 (+141.18%)
s3 asset deployDeploy & manage static assets on S3 with rolling deploys & rollbacks in mind.
Stars: ✭ 63 (+23.53%)