613 Open source projects that are alternatives of or similar to anonymisation

This package features data-science related tasks for developing new recognizers for Presidio. It is used for the evaluation of the entire system, as well as for evaluating specific PII recognizers or PII detection models.

This repository contains demos I made with the Transformers library by HuggingFace.

Code for WECHSEL: Effective initialization of subword embeddings for cross-lingual transfer of monolingual language models.

A (smart) rule based NLP module to extract job skills from text

👑 spaCy building blocks and visualizers for Streamlit apps

Label data using HuggingFace's transformers and automatically get a prediction service

Contextualised Embeddings and Language Modelling using BERT and Friends using R

Pytorch code for ICRA'21 paper: "Hierarchical Cross-Modal Agent for Robotics Vision-and-Language Navigation"

A model library for exploring state-of-the-art deep learning topologies and techniques for optimizing Natural Language Processing neural networks

🔍 Haystack is an open source NLP framework that leverages Transformer models. It enables developers to implement production-ready neural search, question answering, semantic document search and summarization for a wide range of applications.

DrFAQ is a plug-and-play question answering NLP chatbot that can be generally applied to any organisation's text corpora.

Instructions for how to convert a BERT Tensorflow model to work with HuggingFace's pytorch-transformers, and spaCy. This walk-through uses DeepPavlov's RuBERT as example.

✔️Contextual word checker for better suggestions

Abstractive and Extractive Text summarization using Transformers.

Named Entity Recognition (NER) Annotation tool for SpaCy. Generates Traning Data as a JSON which can be readily used.

Pytorch Implementation of GoEmotions 😍😢😱

Persian Bert For Long-Range Sequences

Multi-class text categorization using state-of-the-art pre-trained contextualized language models, e.g. BERT

🛠️ Tools for Transformers compression using PyTorch Lightning ⚡

HugsVision is a easy to use huggingface wrapper for state-of-the-art computer vision

Building a model to recognize incentives for landscape restoration in environmental policies from Latin America, the US and India. Bringing NLP to the world of policy analysis through an extensible framework that includes scraping, preprocessing, active learning and text analysis pipelines.

Tutorials on getting started with PyTorch and TorchText for sentiment analysis.

Super easy library for BERT based NLP models

An NER tool for ancient place names based on Pleiades and Spacy.

2019达观杯信息提取第5名代码

Extensive tutorials for the Advanced NLP Workshop in Open Data Science Conference Europe 2020. We will leverage machine learning, deep learning and deep transfer learning to learn and solve popular tasks using NLP including NER, Classification, Recommendation \ Information Retrieval, Summarization, Classification, Language Translation, Q&A and T…

Kashgari is a production-level NLP Transfer learning framework built on top of tf.keras for text-labeling and text-classification, includes Word2Vec, BERT, and GPT2 Language Embedding.

Tensorflow solution of NER task Using BiLSTM-CRF model with Google BERT Fine-tuning And private Server services

This repository contains code for the O'Reilly Live Online Training for BERT

Keras solution of Chinese NER task using BiLSTM-CRF/BiGRU-CRF/IDCNN-CRF model with Pretrained Language Model: supporting BERT/RoBERTa/ALBERT

A simple zero-dependency React component for tagging user-defined entities within a block of text.

Named Entity Recognition based on dictionaries

How to build and deploy an anonymization API with FastAPI

参考NER，基于BERT的电商评论观点挖掘和情感分析

Pytorch-NLU，一个中文文本分类、序列标注工具包，支持中文长文本、短文本的多类、多标签分类任务，支持中文命名实体识别、词性标注、分词等序列标注任务。 Ptorch NLU, a Chinese text classification and sequence annotation toolkit, supports multi class and multi label classification tasks of Chinese long text and short text, and supports sequence annotation tasks such as Chinese named entity recognition, part of speech ta…

Conversational text Analysis using various NLP techniques

텐서플로2와 머신러닝으로 시작하는 자연어처리 (로지스틱회귀부터 BERT와 GPT3까지) 실습자료

Rank 1 / 216

Text Classification in Turkish Texts with Bert

A PyTorch-based toolkit for natural language processing

Backprop makes it simple to use, finetune, and deploy state-of-the-art ML models.

🤗 ParsBERT Persian NER Tasks

Emotion recognition in conversation

Bangla-Bert is a pretrained bert model for Bengali language

💥 Fast State-of-the-Art Tokenizers optimized for Research and Production

An Open-Source Package for Chinese Open-domain Conversational Chatbot (中文闲聊对话系统，一键部署微信闲聊机器人)

State of the Art Natural Language Processing

中文语言理解测评基准 Chinese Language Understanding Evaluation Benchmark: datasets, baselines, pre-trained models, corpus and leaderboard

Sentence transformers models for SpaCy

classy is a simple-to-use library for building high-performance Machine Learning models in NLP.

Spacy pipeline object for extracting values that correspond to a named entity (e.g., birth dates, account numbers, laboratory results)

🇷🇺 Punctuation restoration production-ready model for Russian language 🇷🇺

Python library for custom entity recognition using Sklearn CRF

中文NER的那些事儿

Weakly supervised medical named entity classification

Text2Text: Cross-lingual natural language processing and generation toolkit

Powerful unsupervised domain adaptation method for dense retrieval. Requires only unlabeled corpus and yields massive improvement: "GPL: Generative Pseudo Labeling for Unsupervised Domain Adaptation of Dense Retrieval" https://arxiv.org/abs/2112.07577

An NLP system for generating reading comprehension questions

Use custom tokenizers in spacy-transformers

KitanaQA: Adversarial training and data augmentation for neural question-answering models