All Projects → divinerapier → weaver

divinerapier / weaver

Licence: Apache-2.0 license
A distributed object file system inspired by the paper Beaver which was published by Facebook Inc. at 2010.

Programming Languages

rust
11053 projects
Makefile
30231 projects

Projects that are alternatives of or similar to weaver

skywalker
A package to allow one to concurrently go through a filesystem with ease
Stars: ✭ 87 (+383.33%)
Mutual labels:  filesystem
cubefs
CubeFS is a cloud native distributed storage platform.
Stars: ✭ 3,062 (+16911.11%)
Mutual labels:  filesystem
TOFileSystemObserver
A bullet-proof mechanism for detecting any changes made to the contents of a folder in iOS and macOS.
Stars: ✭ 35 (+94.44%)
Mutual labels:  filesystem
aliyun-oss-laravel
Laravel 的 Aliyun OSS 扩展, 支持 Laravel 9. Alibaba Cloud Object Storage Service For Laravel.
Stars: ✭ 91 (+405.56%)
Mutual labels:  filesystem
jquery.filebrowser
File browser jQuery plugin
Stars: ✭ 29 (+61.11%)
Mutual labels:  filesystem
Enchilada
Enchilada is a filesystem abstraction layer written in C#
Stars: ✭ 29 (+61.11%)
Mutual labels:  filesystem
-LibraryOS-Exokernel Implementation
Exokernel is one of the major sources for container and library OS techniques.
Stars: ✭ 41 (+127.78%)
Mutual labels:  filesystem
Meteor-logger-file
🔖 Meteor Logging: Store application log messages into file (FS)
Stars: ✭ 24 (+33.33%)
Mutual labels:  filesystem
Transactional-NTFS-TxF-.NET
Transactional NTFS (TxF) Library .NET is a small library .Net (C#) allows to use transactions on NTFS FileSystem (Transactional NTFS (TxF))
Stars: ✭ 20 (+11.11%)
Mutual labels:  filesystem
Aqeous
(Inactive, Checkout AvanaOS, Rewrite of this) This is a New Operating System (Kernel right now). Made completely from scratch, We aim to make a complete OS for Learning purpose
Stars: ✭ 23 (+27.78%)
Mutual labels:  filesystem
save-file
Save any data to file in browser or node
Stars: ✭ 40 (+122.22%)
Mutual labels:  filesystem
lfs
Lightweight file system
Stars: ✭ 12 (-33.33%)
Mutual labels:  filesystem
juicefs-csi-driver
JuiceFS CSI Driver
Stars: ✭ 117 (+550%)
Mutual labels:  filesystem
physfs-old
UNOFFICIAL Git mirror of PhysicsFS Mercurial repository. The official repository has also moved to GitHub; this one will no longer be updated. Official website:
Stars: ✭ 53 (+194.44%)
Mutual labels:  filesystem
Dazinator.Extensions.FileProviders
No description or website provided.
Stars: ✭ 34 (+88.89%)
Mutual labels:  filesystem
crunchdb
A simple JSON based database system written in PHP. Useful for smaller applications.
Stars: ✭ 32 (+77.78%)
Mutual labels:  filesystem
PHP-FileUpload
Simple and convenient file uploads — secure by default
Stars: ✭ 53 (+194.44%)
Mutual labels:  filesystem
rorshach
A watchman for your directories. Rorshach allows you to listen to file system changes and run commands when these events occur.
Stars: ✭ 26 (+44.44%)
Mutual labels:  filesystem
s3-concat
Concatenate Amazon S3 files remotely using flexible patterns
Stars: ✭ 32 (+77.78%)
Mutual labels:  filesystem
fs-fuse
Export any Node.js `fs`-like object as a FUSE filesystem
Stars: ✭ 32 (+77.78%)
Mutual labels:  filesystem

Weaver

Weaver 是一个基于 Facebook Inc.2010 发表的论文 开发的一个分布式对象文件系统。

组件

WeaverGateway

作为所有请求的入口。

WeaverDirectory

  1. 维护逻辑卷到物理卷的映射关系;
  2. 负责对读写数据进行负载均衡;
  3. 维护逻辑卷的空闲空间;
  4. 维护图片对应的逻辑卷;

WeaverCache

Cache 服务是一个分布式缓存,可以使用数据的 ID 对内容进行索引。当缓存命中失败时,负责从后端 Store 服务获取数据。

WeaverStore

每一个 Store 服务维护多个物理卷。每个物理卷存储了百万级别的数据。具体来说,一个物理卷可以被认为是一个超大的文件(比如100G),被保存在物理磁盘上的某个位置。可以通过图片所在物理卷及偏移量,大小等信息快速读取数据。

Architecture

architecture

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].