GitPlanet

Cheap and reliable Node.js hosting starts at $3/month, and $1/month static HTML hosting

Created with love in Canada, visit hostnodejs.com today

Feel like to post an Ad? Learn Details
All Projects → lunatic-cat → xxhashdir

lunatic-cat / xxhashdir

Licence: MIT License
⚡Fast filysystem fingerprinting using xxHash

Programming Languages

go
31211 projects - #10 most used programming language

Labels

hashingfilesystemfingerprintxxhash

Projects that are alternatives of or similar to xxhashdir

BitFact
🛡️ Robust data integrity tool. Prove data, text, & files using the Ethereum blockchain.
Stars: ✭ 42 (-10.64%)
Mutual labels:  hashing, fingerprint
HashDepot
.NET library for xxHash, FNV, MurmurHash3 and SipHash algorithms
Stars: ✭ 107 (+127.66%)
Mutual labels:  hashing, xxhash
VBCorLib
The VBCorLib framework brings many of the powerful .NET classes to VB6.
Stars: ✭ 81 (+72.34%)
Mutual labels:  hashing, filesystem
hdrfs
High Data Retention Filesystem
Stars: ✭ 23 (-51.06%)
Mutual labels:  filesystem
tonix
Tonix provides basic file system functionality, as well as an interactive shell with a Unix-style command line interface.
Stars: ✭ 20 (-57.45%)
Mutual labels:  filesystem
file management sys
file_management_sys 是一个文件共享系统，包括前端文件展示系统和后台管理系统，基于SpringBoot + MyBatis实现。前端文件展示系统包括文件分类和展示界面，文件搜索和文件上传等模块。后台管理系统包含文件管理，权限管理等模块。
Stars: ✭ 60 (+27.66%)
Mutual labels:  filesystem
R30X-Fingerprint-Sensor-Library
Arduino library for R30X series optical fingerprint scanners.
Stars: ✭ 13 (-72.34%)
Mutual labels:  fingerprint
vue-fs
A Vue file management client, complete with a node/express/FS backend.
Stars: ✭ 40 (-14.89%)
Mutual labels:  filesystem
fingerprint-brunch
A brunch plugin for cache busting assets
Stars: ✭ 15 (-68.09%)
Mutual labels:  fingerprint
ImageWorker
ImageWorker is a Library for Android to Save Images in Internal Storage
Stars: ✭ 51 (+8.51%)
Mutual labels:  filesystem
GestureLock
手势解锁 指纹解锁，兼容绝大数手机
Stars: ✭ 89 (+89.36%)
Mutual labels:  fingerprint
laravel-hashid
HashId Implementation on Laravel Eloquent ORM
Stars: ✭ 23 (-51.06%)
Mutual labels:  hashing
SimpleOS
Operating System Coded in Assembly and C
Stars: ✭ 72 (+53.19%)
Mutual labels:  filesystem
woapp
web模拟安卓操作系统，php开发，内置文件管理，电话，短信，拍照，用在树莓派上可做智能家居，视频监控，机顶盒等……
Stars: ✭ 22 (-53.19%)
Mutual labels:  filesystem
ratarmount
Random Access Read-Only Tar Mount
Stars: ✭ 217 (+361.7%)
Mutual labels:  filesystem
fuse xattrs
add xattrs support using sidecar files.
Stars: ✭ 28 (-40.43%)
Mutual labels:  filesystem
acid-store
A library for secure, deduplicated, transactional, and verifiable data storage
Stars: ✭ 48 (+2.13%)
Mutual labels:  filesystem
komihash
Very fast, high-quality hash function (non-cryptographic, C) + PRNG
Stars: ✭ 68 (+44.68%)
Mutual labels:  hashing
secfs.test
Secfs Test Collection - Collection of File System Test Programs
Stars: ✭ 37 (-21.28%)
Mutual labels:  filesystem
browserrecon-php
Advanced Web Browser Fingerprinting
Stars: ✭ 29 (-38.3%)
Mutual labels:  fingerprint
View All Similar Projects ➔

xxhashdir

Build Status

Usage

this package does fast filesystem fingerprinting using xxHash

# instead of "find . -type f -exec xxhsum {} \+"
$ ./xxhashdir .
...
880788507839261490    README.md
11541949788444589007  .travis.yml
6467850080536788703   bin/xxhashdir.go
...

typical CLI use:

./xxhashdir dir > before
# modify fs
./xxhashdir dir > after
diff <(sort before) <(sort after) | sort -nk3

Speed

Times faster than find + exec. Digesting xcode-10.2 with >250K files:

Time Cmd
656 sec time find /Applications/Xcode.app -type f -exec xxhsum {} ; > xxhsum.txt
88 sec time find /Applications/Xcode.app -type f -exec xxhsum {} + > xxhsum.txt
45 sec time ./xxhashdir /Applications/Xcode.app > xxhsumdir.txt

Golang api

func Hashdir(root string, out chan Entry)

where

type Entry struct {
    Path   string
    Xxhash uint64
}
Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].