All Categories → Data Processing → record-linkage

Top 8 record-linkage open source projects

A C library for parsing/normalizing street addresses around the world. Powered by statistical NLP and open geo data.

✭ 3,312

c python machine-learning nlp natural-language-processing address deduplication record-linkage address-parser international deduping

Dedupe

🆔 A python library for accurate and scalable fuzzy matching, record deduplication and entity-resolution.

✭ 3,241

python clustering dedupe record-linkage entity-resolution datamade dedupe-library de-duplicating

record-linkage-resources

Resources for tackling record linkage / deduplication / data matching problems

✭ 67

record-linkage entity-resolution deduplication data-matching

entity-embed

PyTorch library for transforming entities like companies, products, etc. into vectors to support scalable Record Linkage / Entity Resolution using Approximate Nearest Neighbors.

✭ 96

Jupyter Notebook python deep-learning record-linkage entity-resolution pytorch embeddings representation-learning deduplication entity-matching data-matching approximate-nearest-neighbors

splink

Implementation of Fellegi-Sunter's canonical model of record linkage in Apache Spark, including EM algorithm to estimate parameters

✭ 181

Roff python spark record-linkage entity-resolution fuzzy-matching deduplication em-algorithm data-matching deduplicate-data

spark-lucenerdd-examples

Examples of spark-lucenerdd

✭ 15

scala shell docker spark examples record-linkage lucene lucene-query entity-linking

stance

Learned string similarity for entity names using optimal transport.

✭ 27

python shell record-linkage entity-resolution aliases string-distance string-matching optimal-transport string-similarity stance

Merge-Machine

Merge Dirty Data with Clean Reference Tables

✭ 35

python elasticsearch record-linkage entity-resolution entrepreneur-interet-general

1-8 of 8 record-linkage projects