385 Open source projects that are alternatives of or similar to TextDatasetCleaner

Korpuslinguistik war noch nie so einfach...

Weaving analytical stories from text data

This case study shows how to create a model for text analysis and classification and deploy it as a web service in Azure cloud in order to automatically classify support tickets. This project is a proof of concept made by Microsoft (Commercial Software Engineering team) in collaboration with Endava http://endava.com/en

Explaining textual analysis tools in Python. Including Preprocessing, Skip Gram (word2vec), and Topic Modelling.

Text Normalization & Inverse Text Normalization

A keyphrase extractor for Persian

Extract indicators of compromise from text, including "escaped" ones.

Document Enrichment plugin for Elasticsearch

Text Mining in Python

Colibri core is an NLP tool as well as a C++ and Python library for working with basic linguistic constructions such as n-grams and skipgrams (i.e patterns with one or more gaps, either of fixed or dynamic size) in a quick and memory-efficient way. At the core is the tool ``colibri-patternmodeller`` whi ch allows you to build, view, manipulate and query pattern models.

Repo for Applied Text Mining in Python (coursera) by University of Michigan

PipeIt is a text transformation, conversion, cleansing and extraction tool.

🗣️ Tool to generate adversarial text examples and test machine learning models against them

자연어 처리와 텍스트 분석을 위한 오픈소스 파이썬 라이브러리 입니다.

PyNLPl, pronounced as 'pineapple', is a Python library for Natural Language Processing. It contains various modules useful for common, and less common, NLP tasks. PyNLPl can be used for basic tasks such as the extraction of n-grams and frequency lists, and to build simple language model. There are also more complex data types and algorithms. Moreover, there are parsers for file formats common in NLP (e.g. FoLiA/Giza/Moses/ARPA/Timbl/CQL). There are also clients to interface with various NLP specific servers. PyNLPl most notably features a very extensive library for working with FoLiA XML (Format for Linguistic Annotation).

TEANAPS 라이브러리를 활용한 자연어 처리와 텍스트 분석 방법론에 대해 다룹니다.

An easy-to-use library to extract indices from texts.

CogComp's light-weight Python NLP annotators

The aim of this repository is to show a baseline model for text classification by implementing a LSTM-based model coded in PyTorch. In order to provide a better understanding of the model, it will be used a Tweets dataset provided by Kaggle.

短文本聚类预处理模块 Short text cluster

parsing fixed width files content made easy

Deduce: de-identification method for Dutch medical text

Ruby gem to calculate statistics from text to determine readability, complexity and grade level of a particular corpus.

R.TeMiS: R Text Mining Solution

Flexible and powerful platform for biomedical information extraction from text

Term frequency–inverse document frequency for Chinese novel/documents implemented in python.

Easy Linguistics Document Writing with R Markdown

Open-October contribution destination. The Contest has now ended.

Framework for information extraction from tables

Papers about NN and linguistics

Text mining cancer biomarkers for the CIVIC database

PowerShell script for comparing user.js (or prefs.js) files.

A python library to manipulate and transform indexable data (lists, arrays, ...)

Easy Access to Uppercase H

The Metadata Editor for Transparent Archiving of language document materials

A lightweight data processing framework for Apache Spark

Code generation from YAML/JSON/CSV models via SCRIBAN templates

🦛 파이썬 한글 처리 라이브러리. Python Korean Morphological Analyzer

Text Analytics Pipeline (TAP)

Mixing Dirichlet Topic Models and Word Embeddings to Make lda2vec from this paper https://arxiv.org/abs/1605.02019

✔️Contextual word checker for better suggestions

A simple collection of well working NLP models (Keras, H2O, StarSpace) tuned and benchmarked on a variety of datasets.

Tools to uniformly read in text data including semi-structured transcripts

Using Word2Vec to explore semantic similarities between the entities of "A Song of Ice and Fire" ("Game of Thrones").

Named entity recognition (NER) in Russian texts / Определение именованных сущностей (NER) в тексте на русском языке

A Dragnet that also extract author, headline, date, keywords from context

Simple hello world in different language syntax

Utility package for working with classification targets and label-encodings

Layer normalization implemented in Keras

👄 The most accurate natural language detection library for Go, suitable for long and short text alike

[KDD 2020] Hierarchical Topic Mining via Joint Spherical Tree and Text Embedding

Segmentation based event detection from Tweets. Published at NAACL SRW 2019

International Components for Unicode for .NET

Odinson is a powerful and highly optimized open-source framework for rule-based information extraction. Odinson couples a simple, yet powerful pattern language that can operate over multiple representations of text, with a runtime system that operates in near real time.

Text preprocessing tools in python.

Transliterate español (spanish) spelling to andaluz proposals using javascript

Conversational text Analysis using various NLP techniques

The Virtual Lab for Physics

☕ HoC based React forms state manager, Support for validation and normalization.

📊 Tools to Perform ‘Misinformation’ Analysis on a Text Corpus (wrapper for methods in https://github.com/PDXBek/Misinformation)