159 Open source projects that are alternatives of or similar to Snl Compiler

Replaced by foonathan/lexy

C++ Lexer Toolkit Library (LexerTk) https://www.partow.net/programming/lexertk/index.html

A simple interpreter for a large subset of Pascal language written for educational purposes

Lex machinary for go.

Collection of developer toolkits

The fast scanner generator for Java™ with full Unicode support

Parser Building Toolkit for JavaScript

A universal lexer library in Swift.

A modern CSS value compiler in JavaScript

Optimised tokenizer/lexer generator! 🐄 Uses /y for performance. Moo.

🌿 NodeJS PHP Parser - extract AST or tokens (PHP5 and PHP7)

Converts a string into an array of tokens, with useful methods for looking ahead and behind, capturing, matching, et cetera.

Lex is an implementation of lex tool in Ruby.

LLVM Tutorial: Kaleidoscope (Implementing a Language with LLVM)

A very simple python tokenizer for Hebrew text.

Chinese tokenizer for tantivy, based on jieba-rs

使用 PaddlePaddle 实现基于深度神经网络的中文分词引擎 | A DNN Chinese Tokenizer by Using PaddlePaddle

Open Korean Text Processor - An Open-source Korean Text Processor

High performance Chinese tokenizer with both GBK and UTF-8 charset support based on MMSEG algorithm developed by ANSI C. Completely based on modular implementation and can be easily embedded in other programs, like: MySQL, PostgreSQL, PHP, etc.

Expressive, noiseless, interpreted, toy programming language

A Kotlin lexer framework with an easy-to-use DSL

A multilingual command line sentence tokenizer in Golang

📚 µGo语言实现(从头开发一个迷你Go语言编译器)[Go版本+Rust版本]

"Writing an Interpreter in GO" and "Writing a Compiler in GO" in Julia.

Self-contained Japanese Morphological Analyzer written in pure Go

Ekphrasis is a text processing tool, geared towards text from social networks, such as Twitter or Facebook. Ekphrasis performs tokenization, word normalization, word segmentation (for splitting hashtags) and spell correction, using word statistics from 2 big corpora (english Wikipedia, twitter - 330mil english tweets).

The regex-centric, fast lexical analyzer generator for C++ with full Unicode support. Faster than Flex. Accepts Flex specifications. Generates reusable source code that is easy to understand. Introduces indent/dedent anchors, lazy quantifiers, functions for lex/syntax error reporting, and more. Seamlessly integrates with Bison and other parsers.

A simple,gentle,humble scripting language for mallus, based on malayalam memes.

tiny Java compiler

minigo🐥is a small Go compiler made from scratch. It can compile itself.

A Lexical Analyzer Generator

Light and fast 🚀parser! With zero dependents. - Sql Parser Demo added!

Text2Text: Cross-lingual natural language processing and generation toolkit

한국어 자연어처리를 위한 파이썬 라이브러리입니다. 단어 추출/ 토크나이저 / 품사판별/ 전처리의 기능을 제공합니다.

Parser and lexer for PHP

C++ Mathematical Expression Parsing And Evaluation Library

Simple multilingual lemmatizer for Python, especially useful for speed and efficiency

专注于可解释的NLP技术 An NLP Toolset With A Focus on Explainable Inference

Simple C Compiler in OCaml

Python port of Moses tokenizer, truecaser and normalizer

Morphological analyzer `mystem` (Russian language) wrapper for JVM languages

Solves basic Russian NLP tasks, API for lower level Natasha projects

Programming language that compiles into a x86 ELF executable.

Node.js templating engine with fresh air

Tokenize CSS according to the CSS Syntax

Simple Swift interpreter for the Pascal language inspired by the Let’s Build A Simple Interpreter article series.

Tooling to play around with multilingual machine translation for Indian Languages.

编程语言的本质：语言只是一串字符，我们认为它是什么，它就可以是什么

Juman++ (a Morphological Analyzer Toolkit)

VSCode extension to highlight nested code blocks

Simple, interpreted, dynamically-typed programming language

DFA regular expression library & friends

A tiny compiler for a language featuring LL(2) with Lexer, Parser, ASM-like codegen and VM. Complex enough to give you a flavour of how the "real" thing works whilst not being a mere toy example

Lexing, parsing, pretty-printing, and metaprogramming facilities for dealing with GraphQL schemas and queries

Compiler for a language called bshift

C library for Lexical Analysis

Multilingual tokenizer that automatically tags each token with its type

Berserker - BERt chineSE woRd toKenizER

A Python package that do stemming, tokenization, sentence breaking, segmentation, normalization, POS tagging for Arabic language.

Implementing a complete Compiler for a simple C-like language using the C-tools Flex and Bison