437 Open source projects that are alternatives of or similar to chinese-tokenizer

使用 PaddlePaddle 实现基于深度神经网络的中文分词引擎 | A DNN Chinese Tokenizer by Using PaddlePaddle

Scripts demo-ing how to train a Word2Vec model and reduce its vector space

Fast, Consistent Tokenization of Natural Language Text

aim to use JapaneseTokenizer as easy as possible

Greeb is a simple Unicode-aware regexp-based tokenizer.

Extract dates from text

Collection of developer toolkits

The aim of this repository is to show a baseline model for text classification by implementing a LSTM-based model coded in PyTorch. In order to provide a better understanding of the model, it will be used a Tweets dataset provided by Kaggle.

Open source Pan-CJK pixel font / 开源的泛中日韩像素字体

A tokenizer and sentence splitter for German and English web and social media texts.

Colin's ALM Corner Custom Build Tasks

AiSpace: Better practices for deep learning model development and deployment For Tensorflow 2.0

C++ Lexer Toolkit Library (LexerTk) https://www.partow.net/programming/lexertk/index.html

Tiny JavaScript tokenizer.

A shared ESLint configuration with Chinese comments. 一份带有完整中文注释的 ESLint 规则。

Replaced by foonathan/lexy

E-Hentai/ExHentai 全部 TAGs 中文翻译

Parser Building Toolkit for JavaScript

Modern Security Protection Guide

Kadot, the unsupervised natural language processing library.

TTS in command line -- Pronounce the Chinese and English words you typed in.

PHP standards checker.

React hooks for generating QRCode for your next React apps.

上海吳語拼音輸入方案 · 上海吴语拼音输入方案 · Rime input schemas for Shanghai Dialects

PHP calculator library for mathematical terms (expressions) passed as strings

The greynir.is natural language processing website for Icelandic

Source codes of MixPoet: Diverse Poetry Generation via Learning Controllable Mixed Latent Space (AAAI 2020)

邮箱 📧 newsletter RSS 荟萃 News

中文无监督SimCSE Pytorch实现

中文预训练模型生成字向量学习，测试BERT，ELMO的中文效果

Bitextor generates translation memories from multilingual websites.

Essential NLP & ML, short & fast pure Python code

Query Translator is a search query translator with AST representation

A highly configurable vocabulary trainer

R package for Tokenization, Parts of Speech Tagging, Lemmatization and Dependency Parsing Based on the UDPipe Natural Language Processing Toolkit

網頁聊天機器人 | tensorflow implementation of seq2seq model with bahdanau attention and Word2Vec pretrained embedding

Fast and customizable text tokenization library with BPE and SentencePiece support

A desktop web application for learning Mandarin Chinese and its character stroke order.

A Cython MeCab wrapper for fast, pythonic Japanese tokenization and morphological analysis.

記錄有關繁化姬的議題或是內容

Text tokenization and sentence segmentation (segtok v2)

Dialect identification using Siamese network

Source code tokenizer

máobĭ (毛笔) is an Anki add-on to create cards with writing quizzes for Hanzi (Chinese characters)

😻 Markdown with easy tokenization, a fast highlighter, and a lean HTML sanitizer

Chinese NLP Data Augmentation， BERT Contextual Augmentation

Simple yet helpful library for writing Django urls by an easy, short and intuitive way.

Vietnamese tokenizer (Maximum Matching and CRF)

Text to sentence splitter using heuristic algorithm by Philipp Koehn and Josh Schroeder.

Suika 🍉 is a Japanese morphological analyzer written in pure Ruby

Ruby Object Inspection for IRB

A collection of NLP tools for Sinhalese (සිංහල).

Thot toolkit for statistical machine translation

A tokenizer for Icelandic text

A collection of basic python modules for spoken natural language processing

使用uArm Swift Pro机械臂写中文-毛笔字

🏖️ Vanhiupun's Awesome Site ==> another theme for elegant writers with modern flat style and beautiful night/dark mode.

A Vim input method engine

Bag of words meets bags of popcorn in Python 3 中文教程

繁化姬的 Sublime Text 插件