GitPlanet

Cheap and reliable Node.js hosting starts at $3/month, and $1/month static HTML hosting

Created with love in Canada, visit hostnodejs.com today

Feel like to post an Ad? Learn Details
All Projects → shirosaidev → Diskover

shirosaidev / Diskover

Licence: apache-2.0
File system crawler, disk space usage, file search engine and file system analytics powered by Elasticsearch

Programming Languages

python
139335 projects - #7 most used programming language

Labels

elasticsearchcrawlerstoragefilesystemmetadatabotnetdisk-space

Projects that are alternatives of or similar to Diskover

Diskover Web
Web file manager, disk space usage, storage search engine and file system analytics for diskover
Stars: ✭ 121 (-87.62%)
Mutual labels:  disk-space, metadata, elasticsearch, storage, filesystem
Shrine
File Attachment toolkit for Ruby applications
Stars: ✭ 2,903 (+197.13%)
Mutual labels:  metadata, storage, filesystem
diskover-community
Diskover Community Edition - Open source file indexer, file search engine and data management and analytics powered by Elasticsearch
Stars: ✭ 1,257 (+28.66%)
Mutual labels:  metadata, filesystem, disk-space
vzvol
vzvol is a general use ZFS zvol management tool, that handles creation, destruction, listing, and formatting with various FSes, in an easy to use single program
Stars: ✭ 27 (-97.24%)
Mutual labels:  storage, filesystem
News Please
news-please - an integrated web crawler and information extractor for news that just works.
Stars: ✭ 969 (-0.82%)
Mutual labels:  crawler, elasticsearch
Kvpbase
Scalable, simple RESTful object storage platform, written in C#
Stars: ✭ 43 (-95.6%)
Mutual labels:  metadata, storage
Flydrive
☁️ Flexible and Fluent framework-agnostic driver based system to manage storage in Node.js
Stars: ✭ 275 (-71.85%)
Mutual labels:  storage, filesystem
Gopa
[WIP] GOPA, a spider written in Golang, for Elasticsearch. DEMO: http://index.elasticsearch.cn
Stars: ✭ 277 (-71.65%)
Mutual labels:  crawler, elasticsearch
Korio
Korio: Kotlin cORoutines I/O : Virtual File System + Async/Sync Streams + Async TCP Client/Server + WebSockets for Multiplatform Kotlin 1.3
Stars: ✭ 282 (-71.14%)
Mutual labels:  elasticsearch, filesystem
Infinit
The Infinit policy-based software-defined storage platform.
Stars: ✭ 363 (-62.85%)
Mutual labels:  storage, filesystem
Juicefs
JuiceFS is a distributed POSIX file system built on top of Redis and S3.
Stars: ✭ 4,262 (+336.23%)
Mutual labels:  storage, filesystem
Fess
Fess is very powerful and easily deployable Enterprise Search Server.
Stars: ✭ 561 (-42.58%)
Mutual labels:  crawler, elasticsearch
FireFiles
Powerful Android File Manager for everything that runs on Android OS (Android TV, Android Watch, Mobile, etc)
Stars: ✭ 37 (-96.21%)
Mutual labels:  storage, filesystem
gcsfs
Google Cloud Storage filesystem for PyFilesystem2
Stars: ✭ 36 (-96.32%)
Mutual labels:  storage, filesystem
nft.storage
😋 Free decentralized storage and bandwidth for NFTs on IPFS and Filecoin.
Stars: ✭ 309 (-68.37%)
Mutual labels:  metadata, storage
MeowDB.js
Database in JSON (Node.JS Library)
Stars: ✭ 12 (-98.77%)
Mutual labels:  storage, filesystem
Dfc
Report file system space usage information with style (mirror repository)
Stars: ✭ 84 (-91.4%)
Mutual labels:  disk-space, filesystem
Filegator
Powerful Multi-User File Manager
Stars: ✭ 587 (-39.92%)
Mutual labels:  storage, filesystem
Glusterfs
Gluster Filesystem : Build your distributed storage in minutes
Stars: ✭ 3,437 (+251.79%)
Mutual labels:  storage, filesystem
S5cmd
Parallel S3 and local filesystem execution tool.
Stars: ✭ 565 (-42.17%)
Mutual labels:  storage, filesystem
View All Similar Projects ➔

diskover - File system crawler, file search engine and data management and analytics powered by Elasticsearch

License

diskover

diskover is an open source file system crawler that uses Elasticsearch to index and manage data across heterogeneous storage systems. Using diskover, you are able to more effectively search and organize files and system administrators are able to manage storage infrastructure, efficiently provision storage, monitor and report on storage use, and effectively make decisions about new infrastructure purchases.

As the amount of file data generated by businesses continues to expand, the stress on expensive storage infrastructure, users and system administrators, and IT budgets continues to grow.

Using diskover, users can identify old and unused files and give better insights into data change, file duplication and wasted space. diskover supports crawling local file-systems, crawling NFS/SMB, cloud storage, etc. Plugins can be used for adding additional meta data.

diskover runs on Linux, macOS and Windows 10 using Python 3.

News/ Updates

diskover v2 will be released soon (Q1 2021), please sign up and register at https://diskoverdata.com for updates and join diskover Slack workspace. v1 is end of life and is no longer supported.

User Guide

Read the wiki for more documentation on how to install and use diskover.

Discussions/Support

For discussions or support for diskover join the diskover Slack workspace.

Bugs

For bugs about diskover, please use the issues page.

License

See the license file.

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].