GitPlanet

Cheap and reliable Node.js hosting starts at $3/month, and $1/month static HTML hosting

Created with love in Canada, visit hostnodejs.com today

Feel like to post an Ad? Learn Details
All Projects → minio → radio

minio / radio

Licence: AGPL-3.0 License
Redundant Array of Distributed Independent Objectstores in short RADIO performs synchronous mirroring, erasure coding across multiple object stores

Programming Languages

go
31211 projects - #10 most used programming language

Labels

backupreplicationmirrors3s3-bucketdisaster-recovery

Projects that are alternatives of or similar to radio

awesome-storage
A curated list of storage open source tools. Backups, redundancy, sharing, distribution, encryption, etc.
Stars: ✭ 324 (+1196%)
Mutual labels:  backup, replication, s3, s3-bucket
Git S3 Push
Deploy your git repo to an S3 bucket
Stars: ✭ 182 (+628%)
Mutual labels:  backup, s3, s3-bucket
backbeat
Zenko Backbeat is the core engine for asynchronous replication, optimized for queuing metadata updates and dispatching work to long-running tasks in the background.
Stars: ✭ 51 (+104%)
Mutual labels:  replication, s3, disaster-recovery
Wal E
Continuous Archiving for Postgres
Stars: ✭ 3,313 (+13152%)
Mutual labels:  backup, replication, s3
docker-aws-s3-sync
Docker container to sync a folder to Amazon S3
Stars: ✭ 21 (-16%)
Mutual labels:  backup, s3, s3-bucket
BlobHelper
BlobHelper is a common, consistent storage interface for Microsoft Azure, Amazon S3, Komodo, Kvpbase, and local filesystem written in C#.
Stars: ✭ 23 (-8%)
Mutual labels:  s3, s3-bucket
gatsby-source-s3
A Gatsby source plugin to query against an S3 bucket (including images!)
Stars: ✭ 19 (-24%)
Mutual labels:  s3, s3-bucket
n3dr
Nexus3 Disaster Recovery (N3DR) is a tool that is capable of downloading all artifacts from a Nexus3 server and to migrate them to another Nexus3 server. Note that some repository formats are not supported at the moment.
Stars: ✭ 110 (+340%)
Mutual labels:  backup, disaster-recovery
minback-postgres
A container which provides the ability to backup a PostgreSQL database to Minio on demand
Stars: ✭ 18 (-28%)
Mutual labels:  backup, s3
zap
Maintain and replicate ZFS snapshots
Stars: ✭ 48 (+92%)
Mutual labels:  backup, replication
esop
Cloud-enabled backup and restore tool for Apache Cassandra
Stars: ✭ 40 (+60%)
Mutual labels:  backup, s3
Bucket-Flaws
Bucket Flaws ( S3 Bucket Mass Scanner ): A Simple Lightweight Script to Check for Common S3 Bucket Misconfigurations
Stars: ✭ 43 (+72%)
Mutual labels:  s3, s3-bucket
backup-suite
Backup database, static files and config to AWS S3 with Cronjob
Stars: ✭ 32 (+28%)
Mutual labels:  backup, s3
terraform-aws-efs-backup
Terraform module designed to easily backup EFS filesystems to S3 using DataPipeline
Stars: ✭ 40 (+60%)
Mutual labels:  backup, s3
doppelganger
A tool to mirror GitHub repositories.
Stars: ✭ 14 (-44%)
Mutual labels:  backup, mirror
flask-drive
A simple Flask app to upload and download files off Amazon's S3
Stars: ✭ 23 (-8%)
Mutual labels:  s3, s3-bucket
ionic-image-upload
Ionic Plugin for Uploading Images to Amazon S3
Stars: ✭ 26 (+4%)
Mutual labels:  s3, s3-bucket
s3-proxy
S3 Reverse Proxy with GET, PUT and DELETE methods and authentication (OpenID Connect and Basic Auth)
Stars: ✭ 106 (+324%)
Mutual labels:  s3, s3-bucket
minio-rclone-webdav-server
A @rclone served WebDAV server with @minio as the s3 storage backend docker example
Stars: ✭ 17 (-32%)
Mutual labels:  backup, s3
helm-backup
Helm plugin which performs backup/restore of releases in a namespace to/from a file
Stars: ✭ 70 (+180%)
Mutual labels:  backup, disaster-recovery
View All Similar Projects ➔

Radio Quickstart Guide Slack

Redundant Array of Distributed Independent Objectstores in short RADIO performs synchronous mirroring, erasure coding across multiple object stores licensed under AGPLv3.0

Features

  • Mirror
  • Erasure Coded (In-progress)

Architecture

RADIO

Sample Config

---
## Distributed mode for distributed locking
## across many radio instances
distribute:
  peers: https://server{1...32}:9000/
  token: 32bytestring
  certs:
    cert_file: /etc/certs/public.crt
    key_file: /etc/certs/private.key
    ca_path: /etc/certs/CAs

## Local caching based on MinIO
## caching implementation
cache:
  drives:
    - /mnt/cache1
    - /mnt/cache2
    - /mnt/cache3
  exclude:
    - bucket1/*
    - "*.db"
  quota: 90
  expiry: 30

## Radio buckets configuration with all its remotes
## Supports two protection schema's
## - mirror
## - erasure (with parity)
buckets:
  radiobucket1:
    access_key: Q3AM3UQ867SPQQA43P2F
    secret_key: zuf+tfteSlswRu7BJ86wekitnifILbZam1KYY3TG
    protection:
      scheme: mirror
    remote:
      - access_key: TX8mIIOGC12QBMJ45F0Z
        bucket: bucket1
        endpoint: http://replica1:9000
        secret_key: 9ule1ga5JMfMmQXCoEPNcM2jij
      - access_key: GX82IIOGC12QBMJ45F0Z
        bucket: bucket2
        endpoint: http://replica2:9000
        secret_key: 9ux11ga5JMfMmQXCoEPNcM2jij
      - access_key: HX8KIIOGC12QBMJ45F0Z
        bucket: bucket3
        endpoint: http://replica3:9000
        secret_key: 9ux41ga5JMfMmQXCoEPNcM2jij
  radiobucket2:
    access_key: Q3AM3UQ867SPQQA43P2F
    secret_key: zuf+tfteSlswRu7BJ86wekitnifILbZam1KYY3TG
    protection:
      scheme: erasure
      parity: 1
    remote:
      - access_key: TX8mIIOGC12QBMJ45F0Z
        bucket: bucket1
        endpoint: http://erasure1.com:9000
        secret_key: 9ule1ga5JMfMmQXCoEPNcM2jij
      - access_key: GX82IIOGC12QBMJ45F0Z
        bucket: bucket2
        endpoint: http://erasure2.com:9000
        secret_key: 9ux11ga5JMfMmQXCoEPNcM2jij
      - access_key: HX8KIIOGC12QBMJ45F0Z
        bucket: bucket3
        endpoint: http://erasure3.com:9000
        secret_key: 9ux41ga5JMfMmQXCoEPNcM2jij

Starting radio

radio server -c config.yml

Prints the following banner

Endpoint:  http://192.168.1.172:9000  http://172.17.0.1:9000  http://127.0.0.1:9000

Command-line Access: https://docs.min.io/docs/minio-client-quickstart-guide
   $ mc config host add myradio1 http://192.168.1.172:9000 Q3AM3UQ867SPQQA43P2F zuf+tfteSlswRu7BJ86wekitnifILbZam1KYY3TG
...

License

RADIO is an free software project released under the AGPLv3.0 (Affero General Public License).

Contributing

Please see our Code of conduct. We welcome your contributions. Please feel free to fork the code, play with it, make some patches and send us pull requests via issues.

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].