151 Open source projects that are alternatives of or similar to Friso

Chinese tokenizer for tantivy, based on jieba-rs

Berserker - BERt chineSE woRd toKenizER

The Java Package of NLPIR-ICTCLAS.

Tokenize CSS according to the CSS Syntax

A universal lexer library in Swift.

A Python implementation of Farasa toolkit

full text search manpages

🔍 Postgres full-text search (fts)

A very simple python tokenizer for Hebrew text.

Get identifiers, paths, URLs and words from the previous command output and use them for the next command in xonsh shell.

Fast Full Text Search based on BM25

📖 Support examples for learning full-text search with use of PostgreSQL. Ready to run.

Some native scoring script plugins for elasticsearch

Simple multilingual lemmatizer for Python, especially useful for speed and efficiency

Rust re-implementation of OpenFST - library for constructing, combining, optimizing, and searching weighted finite-state transducers (FSTs). A Python binding is also available.

Elasticlunr is a small, full-text search library for use in the Elixir environment. It indexes JSON documents and provides a friendly search interface to retrieve documents.

A Code Index Searching Tools Based On Lucene.Net

Python Groonga Client

A simple tokenizer in Ruby for NLP tasks.

A simple interpreter for a large subset of Pascal language written for educational purposes

A small godot project with a tokenizer written in GDScript.

VSCode extension to highlight nested code blocks

The code of "Making queries" in docs.djangoproject.com that I used in my article "Full-Text Search in Django with PostgreSQL".

使用 PaddlePaddle 实现基于深度神经网络的中文分词引擎 | A DNN Chinese Tokenizer by Using PaddlePaddle

The aim of this repository is to show a baseline model for text classification by implementing a LSTM-based model coded in PyTorch. In order to provide a better understanding of the model, it will be used a Tweets dataset provided by Kaggle.

Multilingual tokenizer that automatically tags each token with its type

Lightweight and read-write optimized full text search library.

Code for IJCAI 2018 paper "Neural Networks Incorporating Unlabeled and Partially-labeled Data for Cross-domain Chinese Word Segmentation"

A modern CSS value compiler in JavaScript

Tokenize English sentences using neural networks.

lesspipe for ripgrep for common new filetypes using few dependencies

Postgres full-text search in Node.js and Sequelize.

Morphological analyzer `mystem` (Russian language) wrapper for JVM languages

🔍 基于讯搜封装的 Laravel 全文检索服务。

Juman++ (a Morphological Analyzer Toolkit)

A PSR-2-R code sniffer and code-style auto-correction-tool - including many useful additions

Gatsby plugin for full text search implementation based on lunr client-side index. Supports multilanguage search.

Lex is an implementation of lex tool in Ruby.

Kirby 3 plugin for adding a search index (sqlite or Algolia).

High-Performance Stemmer, Tokenizer, and Spell Checker for R

A supercharged version of paperless: scan, index and archive all your physical documents

A morphological analysis library.

Python port of Moses tokenizer, truecaser and normalizer

Full-text search with pre-build indexes for Nuxt.js using lunr.js

Tooling to play around with multilingual machine translation for Indian Languages.

A repository to bind mecab for Python 3.5+. Not using swig nor pybind. (Not Maintained Now)

Converts a string into an array of tokens, with useful methods for looking ahead and behind, capturing, matching, et cetera.

Lucene/Solr Analyzer Plugin. Support MacOS,Linux x86/64,Windows x86/64. It's a maven project, which allows you change the lucene/solr version. //Maven工程，修改Lucene/Solr版本，以兼容相应版本。

Tokenizes Chinese texts into words.

A Python package that do stemming, tokenization, sentence breaking, segmentation, normalization, POS tagging for Arabic language.

Suika 🍉 is a Japanese morphological analyzer written in pure Ruby

C library for Lexical Analysis

A tokenizer for Icelandic text

Text2Text: Cross-lingual natural language processing and generation toolkit

C++ Lexer Toolkit Library (LexerTk) https://www.partow.net/programming/lexertk/index.html

A multilingual command line sentence tokenizer in Golang

Browser Extension to full-text search your browsing history & bookmarks.

A driver based solution to searching your Eloquent models supports Laravel 5.2 and Elasticsearch engine.

Fast, efficient, in-memory Full Text Search for Kotlin

Tokenizers and lemmatizers for Go