All Projects → happyfish100 → fastdfs

happyfish100 / fastdfs

Licence: GPL-3.0 license
FastDFS is an open source high performance distributed file system (DFS). It's major functions include: file storing, file syncing and file accessing, and design for high capacity and load balance. Wechat/Weixin public account (Chinese Language): fastdfs

Programming Languages

c
50402 projects - #5 most used programming language
PHP
23972 projects - #3 most used programming language

Projects that are alternatives of or similar to fastdfs

Go Fastdfs
go-fastdfs 是一个简单的分布式文件系统(私有云存储),具有无中心、高性能,高可靠,免维护等优点,支持断点续传,分块上传,小文件合并,自动同步,自动修复。Go-fastdfs is a simple distributed file system (private cloud storage), with no center, high performance, high reliability, maintenance free and other advantages, support breakpoint continuation, block upload, small file merge, automatic synchronization, automatic r…
Stars: ✭ 2,923 (-64.24%)
Mutual labels:  storage-servers, distributed-file-system, distributed-file-storage
distkv
Distributed KV Storage System based on Raft and RocksDB, can be use to store small files, like images.
Stars: ✭ 50 (-99.39%)
Mutual labels:  distributed-file-system, distributed-file-storage
rusix
Distributed filesystem in Rust
Stars: ✭ 50 (-99.39%)
Mutual labels:  distributed-file-system
ucz-dfs
A distributed file system written in Rust.
Stars: ✭ 25 (-99.69%)
Mutual labels:  distributed-file-system
zabbix-glusterfs
Monitoring GlusterFS Discovery storage with Zabbix 3.4
Stars: ✭ 17 (-99.79%)
Mutual labels:  distributed-file-system
Seaweedfs
SeaweedFS is a fast distributed storage system for blobs, objects, files, and data lake, for billions of files! Blob store has O(1) disk seek, cloud tiering. Filer supports Cloud Drive, cross-DC active-active replication, Kubernetes, POSIX FUSE mount, S3 API, S3 Gateway, Hadoop, WebDAV, encryption, Erasure Coding.
Stars: ✭ 13,380 (+63.71%)
Mutual labels:  distributed-file-system
Leofs
The LeoFS Storage System
Stars: ✭ 1,439 (-82.39%)
Mutual labels:  distributed-file-system
yfs
🏠超精简分布式对象存储
Stars: ✭ 35 (-99.57%)
Mutual labels:  distributed-file-system
miniDFS
Simple version of Distributed File System on multiple threads
Stars: ✭ 38 (-99.54%)
Mutual labels:  distributed-file-system

Copyright (C) 2008 Happy Fish / YuQing

FastDFS may be copied only under the terms of the GNU General Public License V3, which may be found in the FastDFS source kit. Please visit the FastDFS Home Page for more detail. Chinese language: http://www.fastken.com/

FastDFS is an open source high performance distributed file system. It's major functions include: file storing, file syncing and file accessing (file uploading and file downloading), and it can resolve the high capacity and load balancing problem. FastDFS should meet the requirement of the website whose service based on files such as photo sharing site and video sharing site.

FastDFS has two roles: tracker and storage. The tracker takes charge of scheduling and load balancing for file access. The storage store files and it's function is file management including: file storing, file syncing, providing file access interface. It also manage the meta data which are attributes representing as key value pair of the file. For example: width=1024, the key is "width" and the value is "1024".

The tracker and storage contain one or more servers. The servers in the tracker or storage cluster can be added to or removed from the cluster by any time without affecting the online services. The servers in the tracker cluster are peer to peer.

The storarge servers organizing by the file volume/group to obtain high capacity. The storage system contains one or more volumes whose files are independent among these volumes. The capacity of the whole storage system equals to the sum of all volumes' capacity. A file volume contains one or more storage servers whose files are same among these servers. The servers in a file volume backup each other, and all these servers are load balancing. When adding a storage server to a volume, files already existing in this volume are replicated to this new server automatically, and when this replication done, system will switch this server online to providing storage services.

When the whole storage capacity is insufficiency, you can add one or more volumes to expand the storage capacity. To do this, you need to add one or more storage servers.

The identification of a file is composed of two parts: the volume name and the file name.

Client test code use client library please refer to the directory: client/test.

For more FastDFS related articles, please subscribe the Wechat/Weixin public account (Chinese Language): fastdfs

FastDFS is a lightweight object storage solution. If you need a general distributed file system for databases, K8s and virtual machines (such as KVM), you can learn about FastCFS which achieves strong data consistency and high performance.

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].