All Projects → jszwec → S3fs

jszwec / S3fs

Licence: mit
S3 FileSystem (fs.FS) implementation

Programming Languages

go
31211 projects - #10 most used programming language
golang
3204 projects

Projects that are alternatives of or similar to S3fs

Bucket-Flaws
Bucket Flaws ( S3 Bucket Mass Scanner ): A Simple Lightweight Script to Check for Common S3 Bucket Misconfigurations
Stars: ✭ 43 (-53.76%)
Mutual labels:  s3, s3-bucket
radio
Redundant Array of Distributed Independent Objectstores in short RADIO performs synchronous mirroring, erasure coding across multiple object stores
Stars: ✭ 25 (-73.12%)
Mutual labels:  s3, s3-bucket
s3-proxy
S3 Reverse Proxy with GET, PUT and DELETE methods and authentication (OpenID Connect and Basic Auth)
Stars: ✭ 106 (+13.98%)
Mutual labels:  s3, s3-bucket
Go Storage
An application-oriented unified storage layer for Golang.
Stars: ✭ 87 (-6.45%)
Mutual labels:  s3, fs
S3monkey
A Python library that allows you to interact with Amazon S3 Buckets as if they are your local filesystem.
Stars: ✭ 399 (+329.03%)
Mutual labels:  s3, fs
go-storage
A vendor-neutral storage library for Golang: Write once, run on every storage service.
Stars: ✭ 387 (+316.13%)
Mutual labels:  fs, s3
docker-aws-s3-sync
Docker container to sync a folder to Amazon S3
Stars: ✭ 21 (-77.42%)
Mutual labels:  s3, s3-bucket
s3cr3t
A supercharged S3 reverse proxy
Stars: ✭ 55 (-40.86%)
Mutual labels:  s3, s3-bucket
Goofys
a high-performance, POSIX-ish Amazon S3 file system written in Go
Stars: ✭ 3,932 (+4127.96%)
Mutual labels:  s3, s3-bucket
simply-static-deploy
WordPress plugin to deploy static sites easily to an AWS S3 bucket.
Stars: ✭ 48 (-48.39%)
Mutual labels:  s3, s3-bucket
gatsby-source-s3
A Gatsby source plugin to query against an S3 bucket (including images!)
Stars: ✭ 19 (-79.57%)
Mutual labels:  s3, s3-bucket
Minio Hs
MinIO Client SDK for Haskell
Stars: ✭ 39 (-58.06%)
Mutual labels:  s3, s3-bucket
BlobHelper
BlobHelper is a common, consistent storage interface for Microsoft Azure, Amazon S3, Komodo, Kvpbase, and local filesystem written in C#.
Stars: ✭ 23 (-75.27%)
Mutual labels:  s3, s3-bucket
flask-drive
A simple Flask app to upload and download files off Amazon's S3
Stars: ✭ 23 (-75.27%)
Mutual labels:  s3, s3-bucket
awesome-storage
A curated list of storage open source tools. Backups, redundancy, sharing, distribution, encryption, etc.
Stars: ✭ 324 (+248.39%)
Mutual labels:  s3, s3-bucket
ionic-image-upload
Ionic Plugin for Uploading Images to Amazon S3
Stars: ✭ 26 (-72.04%)
Mutual labels:  s3, s3-bucket
terraform-aws-s3
Terraform module to create default S3 bucket with logging and encryption type specific features.
Stars: ✭ 22 (-76.34%)
Mutual labels:  s3, s3-bucket
s3recon
Amazon S3 bucket finder and crawler.
Stars: ✭ 111 (+19.35%)
Mutual labels:  s3, s3-bucket
terraform-aws-s3-bucket
A Terraform module to create a Simple Storage Service (S3) Bucket on Amazon Web Services (AWS). https://aws.amazon.com/s3/
Stars: ✭ 47 (-49.46%)
Mutual labels:  s3, s3-bucket
S3 Site Cache Optimizer
Optimize a static website for hosting in S3, by including a fingerprint into all assets' filenames. The optimized website is uploaded into the specified S3 bucket with the right cache headers.
Stars: ✭ 9 (-90.32%)
Mutual labels:  s3, s3-bucket

s3fs Go Reference Go

Package s3fs provides a S3 implementation for Go1.16 filesystem interface.

Since S3 is a flat structure, s3fs simulates directories by using prefixes and "/" delim. ModTime on directories is always zero value.

The implementation wraps aws sdk go s3 client.

const bucket = "my-bucket"

s, err := session.NewSession()
if err != nil {
    log.Fatal(err)
}

s3fs := s3fs.New(s3.New(s), bucket)

// print out all files in s3 bucket.
_ = fs.WalkDir(s3fs, ".", func(path string, d fs.DirEntry, err error) error {
    if err != nil {
        return err
    }

    if d.IsDir() {
        fmt.Println("dir:", path)
        return nil
    }
    fmt.Println("file:", path)
    return nil
})

Installation

go get github.com/jszwec/s3fs

Requirements

  • Go1.16+
Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].