955 Open source projects that are alternatives of or similar to Open Korean Text

Ekphrasis is a text processing tool, geared towards text from social networks, such as Twitter or Facebook. Ekphrasis performs tokenization, word normalization, word segmentation (for splitting hashtags) and spell correction, using word statistics from 2 big corpora (english Wikipedia, twitter - 330mil english tweets).

Multi-layer Recurrent Neural Networks for character-level language models implements by TensorFlow

Self-contained Japanese Morphological Analyzer written in pure Go

A collection of basic python modules for spoken natural language processing

Fast and customizable text tokenization library with BPE and SentencePiece support

CogComp's light-weight Python NLP annotators

Python library for Natural Language Preprocessing (NLPre)

THE String Processing Package for R (with ICU)

Text vectorization tool to outperform TFIDF for classification tasks

Thot toolkit for statistical machine translation

The aim of this repository is to show a baseline model for text classification by implementing a LSTM-based model coded in PyTorch. In order to provide a better understanding of the model, it will be used a Tweets dataset provided by Kaggle.

A repository to bind mecab for Python 3.5+. Not using swig nor pybind. (Not Maintained Now)

A Python package that do stemming, tokenization, sentence breaking, segmentation, normalization, POS tagging for Arabic language.

Library for Korean morpheme and word vector representation

KoBERT와 CRF로 만든 한국어 개체명인식기 (BERT+CRF based Named Entity Recognition model for Korean)

Mycroft's multilingual text parsing and formatting library

🌿 An easy-to-use Japanese Text Processing tool, which makes it possible to switch tokenizers with small changes of code.

Kadot, the unsupervised natural language processing library.

Korean spellchecking dictionary for Hunspell

Preprocessing Library for Natural Language Processing

Stanford NLP group's shared Python tools.

The greynir.is natural language processing website for Icelandic

fastNLP: A Modularized and Extensible NLP Framework. Currently still in incubation.

R package for Tokenization, Parts of Speech Tagging, Lemmatization and Dependency Parsing Based on the UDPipe Natural Language Processing Toolkit

🦛 파이썬 한글 처리 라이브러리. Python Korean Morphological Analyzer

PyNLPl, pronounced as 'pineapple', is a Python library for Natural Language Processing. It contains various modules useful for common, and less common, NLP tasks. PyNLPl can be used for basic tasks such as the extraction of n-grams and frequency lists, and to build simple language model. There are also more complex data types and algorithms. Moreover, there are parsers for file formats common in NLP (e.g. FoLiA/Giza/Moses/ARPA/Timbl/CQL). There are also clients to interface with various NLP specific servers. PyNLPl most notably features a very extensive library for working with FoLiA XML (Format for Linguistic Annotation).

A curated awesome list of AI Startups in India & Machine Learning Interview Guide. Feel free to contribute!

Github repo with tutorials to fine tune transformers for diff NLP tasks

Source code for end-to-end dialogue model from the MultiWOZ paper (Budzianowski et al. 2018, EMNLP)

The fast scanner generator for Java™ with full Unicode support

Official implementations for various pre-training models of ERNIE-family, covering topics of Language Understanding & Generation, Multimodal Understanding & Generation, and beyond.

CogComp's Natural Language Processing libraries and Demos:

A neural network architecture for NLP tasks, using cython for fast performance. Currently, it can perform POS tagging, SRL and dependency parsing.

Repository to track the progress in Natural Language Processing (NLP), including the datasets and the current state-of-the-art for the most common NLP tasks.

Portuguese pre-trained BERT models

Programming Assignments and Lectures for Stanford's CS 224: Natural Language Processing with Deep Learning

Distantly Supervised Relation Extraction

A fast implementation of Aho-Corasick in Rust.

Automatic summarizer text in Swift

A curated list of beginner resources in Natural Language Processing

NLP in Python with Deep Learning

A list of recent papers about Graph Neural Network methods applied in NLP areas.

Collection of useful data science topics along with code and articles

A curated list of recent models of text generation and application

🔡 Token level embeddings from BERT model on mxnet and gluonnlp

A tool to query a database in natural language

South Korea administrative divisions in ESRI Shapefile, GeoJSON and TopoJSON formats.

[UNMANTEINED] Extract values from strings and fill your structs with nlp.

Một cuốn sách tương tác về học sâu có mã nguồn, toán và thảo luận. Đề cập đến nhiều framework phổ biến (TensorFlow, Pytorch & MXNet) và được sử dụng tại 175 trường Đại học.

🇰🇷 TypeScript Handbook in Korean

Facilitating the design, comparison and sharing of deep text matching models.

Code For Medium Article: "How To Create Natural Language Semantic Search for Arbitrary Objects With Deep Learning"

Optimised tokenizer/lexer generator! 🐄 Uses /y for performance. Moo.

📡 Organized Resources for Deep Learning in Natural Language Processing

Course repo for Applied Natural Language Processing (Spring 2019)

Awesome Search - this is all about the (e-commerce) search and its awesomeness

👑 spaCy building blocks and visualizers for Streamlit apps

🪐 End-to-end NLP workflows from prototype to production

Neural question generation using transformers

Resources for learning about Text Mining and Natural Language Processing