All Projects → rylans → Getlang

rylans / Getlang

Licence: mit
Natural language detection package in pure Go

Programming Languages

go
31211 projects - #10 most used programming language

Projects that are alternatives of or similar to Getlang

Awesome Sentence Embedding
A curated list of pretrained sentence and word embedding models
Stars: ✭ 1,973 (+1693.64%)
Mutual labels:  language-model, natural-language
Pytorch gbw lm
PyTorch Language Model for 1-Billion Word (LM1B / GBW) Dataset
Stars: ✭ 101 (-8.18%)
Mutual labels:  language-model
Full stack transformer
Pytorch library for end-to-end transformer models training, inference and serving
Stars: ✭ 71 (-35.45%)
Mutual labels:  language-model
Text Gan Tensorflow
TensorFlow GAN implementation using Gumbel Softmax
Stars: ✭ 87 (-20.91%)
Mutual labels:  language-model
Retext Simplify
plugin to check phrases for simpler alternatives
Stars: ✭ 81 (-26.36%)
Mutual labels:  natural-language
Pyclue
Python toolkit for Chinese Language Understanding(CLUE) Evaluation benchmark
Stars: ✭ 91 (-17.27%)
Mutual labels:  language-model
Nezha chinese pytorch
NEZHA: Neural Contextualized Representation for Chinese Language Understanding
Stars: ✭ 65 (-40.91%)
Mutual labels:  language-model
Transformers
🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
Stars: ✭ 55,742 (+50574.55%)
Mutual labels:  language-model
Assistantjs
TypeScript framework to build cross-platform voice applications (alexa, google home, ...).
Stars: ✭ 100 (-9.09%)
Mutual labels:  natural-language
Stemmer
Fast Porter stemmer implementation
Stars: ✭ 86 (-21.82%)
Mutual labels:  natural-language
Bit Rnn
Quantize weights and activations in Recurrent Neural Networks.
Stars: ✭ 86 (-21.82%)
Mutual labels:  language-model
Greek Bert
A Greek edition of BERT pre-trained language model
Stars: ✭ 84 (-23.64%)
Mutual labels:  language-model
Forte
Forte is a flexible and powerful NLP builder FOR TExt. This is part of the CASL project: http://casl-project.ai/
Stars: ✭ 89 (-19.09%)
Mutual labels:  natural-language
Cognitive Social Crm
An application that monitors a Twitter feed and determines customer sentiment using IBM Watson Assistant, Tone Analyzer, Natural Language Understanding, as well as CloudantDB
Stars: ✭ 71 (-35.45%)
Mutual labels:  natural-language
Openseq2seq
Toolkit for efficient experimentation with Speech Recognition, Text2Speech and NLP
Stars: ✭ 1,378 (+1152.73%)
Mutual labels:  language-model
Rasa nlu chi
Turn Chinese natural language into structured data 中文自然语言理解
Stars: ✭ 1,166 (+960%)
Mutual labels:  natural-language
Pytorch Openai Transformer Lm
🐥A PyTorch implementation of OpenAI's finetuned transformer language model with a script to import the weights pre-trained by OpenAI
Stars: ✭ 1,268 (+1052.73%)
Mutual labels:  language-model
Tongrams
A C++ library providing fast language model queries in compressed space.
Stars: ✭ 88 (-20%)
Mutual labels:  language-model
Node Sdk
☄️ Node.js library to access IBM Watson services.
Stars: ✭ 1,471 (+1237.27%)
Mutual labels:  natural-language
Easy Bert
A Dead Simple BERT API for Python and Java (https://github.com/google-research/bert)
Stars: ✭ 106 (-3.64%)
Mutual labels:  language-model

getlang

GoDoc Go Report Card Build Status cover.run go

getlang provides fast natural language detection in Go.

Features

  • Offline -- no internet connection required
  • Supports 29 languages
  • Provides ISO 639 language codes
  • Fast

Getting started

Installation:

    go get -u github.com/rylans/getlang

example:

package main

import (
	"fmt"
	"github.com/rylans/getlang"
)

func main(){
  info := getlang.FromString("Wszyscy ludzie rodzą się wolni i równi w swojej godności i prawach")
  fmt.Println(info.LanguageCode(), info.Confidence())
}

Documentation

getlang on godoc

License

MIT

Acknowledgements and Citations

  • Thanks to abadojack for the trigram generation logic in whatlanggo
  • Cavnar, William B., and John M. Trenkle. "N-gram-based text categorization." Ann arbor mi 48113.2 (1994): 161-175.
Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].