All Categories → Data Processing → dedupe

Top 9 dedupe open source projects

Fast, secure, efficient backup program

✭ 15,105

go backup deduplication secure-by-default dedupe restic

🆔 A python library for accurate and scalable fuzzy matching, record deduplication and entity-resolution.

✭ 3,241

python clustering dedupe record-linkage entity-resolution datamade dedupe-library de-duplicating

Fast block-level out-of-band BTRFS deduplication tool.

✭ 108

python shell Dockerfile dedupe btrfs deduplication btrfs-progs btrfs-tools

A fast file deduplicator

✭ 147

rust macos dedupe rust-library file-deduplication hardlinks dupes

Yet Another Dupes Finder

✭ 32

rust python shell dedupe deduplication fdupes duplicate-detection file-deduplication dupes-finder

Scalable identity resolution, entity resolution, data mastering and deduplication using ML

django-super-deduper

Utilities for de-duping Django model instances

✭ 27

python Dockerfile django dedupe

mail-deduplicate

📧 CLI to deduplicate mails from mail boxes.

✭ 134

python cli mail email dedupe mailbox cleanup maildir mbox deduplication mh babyl mmdf

Duplicate code finder for Elixir

✭ 20

elixir lint escript static-code-analysis dedupe static-analysis duplex

1-9 of 9 dedupe projects