242 Open source projects that are alternatives of or similar to Pipeit

Deduce: de-identification method for Dutch medical text

A keyphrase extractor for Persian

Text Mining in Python

Explaining textual analysis tools in Python. Including Preprocessing, Skip Gram (word2vec), and Topic Modelling.

Extract indicators of compromise from text, including "escaped" ones.

Korpuslinguistik war noch nie so einfach...

Repo for Applied Text Mining in Python (coursera) by University of Michigan

TEANAPS 라이브러리를 활용한 자연어 처리와 텍스트 분석 방법론에 대해 다룹니다.

The aim of this repository is to show a baseline model for text classification by implementing a LSTM-based model coded in PyTorch. In order to provide a better understanding of the model, it will be used a Tweets dataset provided by Kaggle.

CogComp's light-weight Python NLP annotators

parsing fixed width files content made easy

An easy-to-use library to extract indices from texts.

🗣️ Tool to generate adversarial text examples and test machine learning models against them

短文本聚类预处理模块 Short text cluster

자연어 처리와 텍스트 분석을 위한 오픈소스 파이썬 라이브러리 입니다.

Weaving analytical stories from text data

🔬 Очистка датасетов от мусора (нормализация, препроцессинг)

This case study shows how to create a model for text analysis and classification and deploy it as a web service in Azure cloud in order to automatically classify support tickets. This project is a proof of concept made by Microsoft (Commercial Software Engineering team) in collaboration with Endava http://endava.com/en

Open Korean Text Processor - An Open-source Korean Text Processor

Ekphrasis is a text processing tool, geared towards text from social networks, such as Twitter or Facebook. Ekphrasis performs tokenization, word normalization, word segmentation (for splitting hashtags) and spell correction, using word statistics from 2 big corpora (english Wikipedia, twitter - 330mil english tweets).

Various Algorithms for Short Text Mining

A fast implementation of Aho-Corasick in Rust.

Text mining using tidy tools ✨📄✨

🔤 Lightweight R package for manipulating [string] characters

Open Source research tool to search, browse, analyze and explore large document collections by Semantic Search Engine and Open Source Text Mining & Text Analytics platform (Integrates ETL for document processing, OCR for images & PDF, named entity recognition for persons, organizations & locations, metadata management by thesaurus & ontologies, search user interface & search apps for fulltext search, faceted search & knowledge graph)

Resources for learning about Text Mining and Natural Language Processing

Diff Match Patch is a high-performance library in multiple languages that manipulates plain text.

Ipython Notebooks for solving problems like classification, segmentation, generation using latest Deep learning algorithms on different publicly available text and image data-sets.

💫 Automated codification of Greek Legislation with NLP

AutoPhrase: Automated Phrase Mining from Massive Text Corpora

Language, Knowledge, Cognition

PyNLPl, pronounced as 'pineapple', is a Python library for Natural Language Processing. It contains various modules useful for common, and less common, NLP tasks. PyNLPl can be used for basic tasks such as the extraction of n-grams and frequency lists, and to build simple language model. There are also more complex data types and algorithms. Moreover, there are parsers for file formats common in NLP (e.g. FoLiA/Giza/Moses/ARPA/Timbl/CQL). There are also clients to interface with various NLP specific servers. PyNLPl most notably features a very extensive library for working with FoLiA XML (Format for Linguistic Annotation).

Python implementation of bag-of-concepts

Simple SQL-like syntax on top of Perl text processing.

Python library for creating PEG parsers

RMDL: Random Multimodel Deep Learning for Classification

Hatena Notation (はてな記法) Parser written in Go

MetaSRA: normalized sample-specific metadata for the Sequence Read Archive

Python implementation of the Rapid Automatic Keyword Extraction algorithm using NLTK.

R client for the PLoS Journals API

extract text from any document. no muss. no fuss.

Textpipe: clean and extract metadata from text

Mycroft's multilingual text parsing and formatting library

An idiomatic and fast QP-trie implementation in pure Rust.

📈 Regression and Classification with UC Davis student quiz data and exam data

Starter code to solve real world text data problems. Includes: Gensim Word2Vec, phrase embeddings, Text Classification with Logistic Regression, word count with pyspark, simple text preprocessing, pre-trained embeddings and more.

Machine Learning Lectures at the European Space Agency (ESA) in 2018

Python文本挖掘系统 Research of Text Mining System

Fast vectorization, topic modeling, distances and GloVe word embeddings in R.

This repository contains the code related to Natural Language Processing using python scripting language. All the codes are related to my book entitled "Python Natural Language Processing"

A Python package that do stemming, tokenization, sentence breaking, segmentation, normalization, POS tagging for Arabic language.

Manuscript of the book "Tidy Text Mining with R" by Julia Silge and David Robinson

Fast topic modeling platform

Text summarization starting from scratch.

Just a crawler based on tg-cli for Telegram. Deprecated by now, please use telegram-export.

A collection of notebooks for Natural Language Processing from NLP Town

🐎 A fast implementation of the Aho-Corasick algorithm using the compact double-array data structure.

An implementation of "Network Representation Learning with Rich Text Information" (IJCAI '15).

NLP pipeline software using common workflow language

从新浪财经、每经网、金融界、中国证券网、证券时报网上，爬取上市公司（个股）的历史新闻文本数据进行文本分析、提取特征集，然后利用SVM、随机森林等分类器进行训练，最后对实施抓取的新闻数据进行分类预测