83 Open source projects that are alternatives of or similar to Rltk

A toolkit for record linkage and duplicate detection in Python

RocketMQ消息幂等去重消费者，支持使用MySQL或者Redis做幂等表，开箱即用

String similarity metrics for Elixir

通过余弦定理+分词计算文本相似度PHP版

medical image visualization library and development toolkit

自然语言处理工具Macropodus，基于Albert+BiLSTM+CRF深度学习网络架构，中文分词，词性标注，命名实体识别，新词发现，关键词，文本摘要，文本相似度，科学计算器，中文数字阿拉伯数字(罗马数字)转换，中文繁简转换，拼音转换。tookit(tool) of NLP，CWS(chinese word segnment)，POS(Part-Of-Speech Tagging)，NER(name entity recognition)，Find(new words discovery)，Keyword(keyword extraction)，Summarize(text summarization)，Sim(text similarity)，Calculate(scientific calculator)，Chi2num(chinese number to arabic number)

Yet Another Dupes Finder

Data deduplication engine, supporting optional compression and public key encryption.

推荐算法、相似度算法、布隆过滤器、均值算法、一致性Hash、数据结构、leetcode练习

difPy - Python package for finding duplicate or similar images within folders

Web Scraping, Document Deduplication & GPT-2 Fine-tuning with a newly created scam dataset.

A library for secure, deduplicated, transactional, and verifiable data storage

综合了同义词词林扩展版与知网（Hownet）的词语相似度计算方法，词汇覆盖更多、结果更准确。

find/file similar

A powerful duplicate file finder and an enhanced fork of 'fdupes'.

Sørensen–Dice coefficient

Dedupe/batch geocode addresses and venues around the world with libpostal

Computing similarity of two sentences with google's BERT algorithm。利用Bert计算句子相似度。语义相似度计算。文本相似度计算。

FastCDC implementation in Rust

Deduplicating archiver with encryption and paranoid-level tests. Swiss army knife for the serious backup and disaster recovery manager. Ransomware neutralizer. Win/Linux/Unix

Generate duplex/single consensus reads to reduce sequencing noises and remove duplications

Reaction Decoder Tool (RDT) - Atom Atom Mapping Tool

Straightforward fuzzy matching, information retrieval and NLP building blocks for JavaScript.

PyTorch library for transforming entities like companies, products, etc. into vectors to support scalable Record Linkage / Entity Resolution using Approximate Nearest Neighbors.

Fast multi-threaded content-dependent chunking deduplication for Buffers in C++ with a reference implementation in Javascript. Ships with extensive tests, a fuzz test and a benchmark.

Deduplicating filesystem via Python3, FUSE and SQLite

Fast block-level out-of-band BTRFS deduplication tool.

Cross-platform backup tool for Windows, macOS & Linux with fast, incremental backups, client-side end-to-end encryption, compression and data deduplication. CLI and GUI included.

Malware similarity platform with modularity in mind.

Simple, configuration-driven backup software for servers and workstations

Advanced similarity and duplicate source code proof of concept for our research efforts.

Prometheus Alertmanager

Tool for managing data-deduplication within extant compressed archive files, along with a relatively performant BK tree implementation for fuzzy image searching.

Machine learning based text classification in JavaScript using n-grams and cosine similarity

地理编码技术，提供地址标准化和相似度计算。

A C library for parsing/normalizing street addresses around the world. Powered by statistical NLP and open geo data.

Ideas for chemical similarity searches in MongoDB.

similarity：相似度计算工具包，java编写。用于词语、短语、句子、词法分析、情感分析、语义分析等相关的相似度计算。

Cargo with less noise: warnings are skipped until errors are fixed, Neovim integration, etc.

Accelerating the deduplication and collapsing process for reads with Unique Molecular Identifiers (UMI). Heavily optimized for scalability and orders of magnitude faster than a previous tool.

NetworkX-based Python library for representing ontologies

Best Practices, code samples, and documentation for Computer Vision.

Scalable identity resolution, entity resolution, data mastering and deduplication using ML

Resources for tackling record linkage / deduplication / data matching problems

Drug-Drug Interaction Predicting by Neural Network Using Integrated Similarity

Image similarity comparison simulating human perception (multiscale SSIM in Rust)

vektonn.github.io/vektonn

9 tools for Goodreads.com, for finding people based on the books they’ve read, finding books popular among the people you follow, following new book reviews, etc

📧 CLI to deduplicate mails from mail boxes.

Damerau - Levenstein distance function for node

Implementation for <Neural Similarity Learning> in NeurIPS'19.

Implementation, trained models and result data for the paper "Pairwise Multi-Class Document Classification for Semantic Relations between Wikipedia Articles"

A backup program that does deduplication, compression, encryption

A library implementing different string similarity and distance measures using Python.

A Clojure library for querying large data-sets on similarity

Extremely fast tool to remove duplicates and other lint from your filesystem

📊 python package for performing deduplication using flexible text matching and cleaning in pandas dataframe

R package to Embed All the Things! using StarSpace

pytorch implementation of the TwinBert paper

Implementation of Fellegi-Sunter's canonical model of record linkage in Apache Spark, including EM algorithm to estimate parameters