All Projects → facebookincubator → Logdevice

facebookincubator / Logdevice

Licence: other
Distributed storage for sequential data

Programming Languages

C++
36643 projects - #6 most used programming language
python
139335 projects - #7 most used programming language
CMake
9771 projects
Thrift
134 projects
Pawn
127 projects
javascript
184084 projects - #8 most used programming language

LogDevice

Build Status Gitter

Note: This is an archived project and is no longer supported or updated by Facebook.

LogDevice is a scalable and fault tolerant distributed log system. While a file-system stores and serves data organized as files, a log system stores and delivers data organized as logs. The log can be viewed as a record-oriented, append-only, and trimmable file.

LogDevice is designed from the ground up to serve many types of logs with high reliability and efficiency at scale. It's also highly tunable, allowing each use case to be optimized for the right set of trade-offs in the durability-efficiency and consistency-availability space. Here are some examples of workloads supported by LogDevice:

  • Write-ahead logging for durability
  • Transaction logging in a distributed database
  • Event logging
  • Stream processing
  • ML training pipelines
  • Replicated state machines
  • Journals of deferred work items

For full documentation, please visit logdevice.io.

Requirements

LogDevice is only supported on Ubuntu 18.04 (Bionic Beaver). However, it should be possible to build it on any other Linux distribution without significant challenges. LogDevice relies on some c++17 features, so building LogDevice requires a compiler that supports c++17.

Quick Start

Documentation

Build LogDevice

Join the LogDevice community

Contributors

See the CONTRIBUTING file for how to help out.

License

LogDevice is BSD licensed, as found in the LICENSE file.

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].