186 Open source projects that are alternatives of or similar to Indian_ParallelCorpus

This repository contains the code and data of the paper titled "Not Low-Resource Anymore: Aligner Ensembling, Batch Filtering, and New Datasets for Bengali-English Machine Translation" published in Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP 2020), November 16 - November 20, 2020.

The Business Scene Dialogue corpus

Tooling to play around with multilingual machine translation for Indian Languages.

Open-source benchmark datasets and pretrained transformer models in the Filipino language.

Preprocessed Python functions and docstrings for automated code documentation (code2doc) and automated code generation (doc2code) tasks.

Resources to go with the Indic NLP Library

FoLiA: Format for Linguistic Annotation - FoLiA is a rich XML-based annotation format for the representation of language resources (including corpora) with linguistic annotations. A wide variety of linguistic annotations are supported, making FoLiA a useful format for NLP tasks and data interchange. Note that the actual Python library for proces…

Japanese Realistic Textual Entailment Corpus (NLP 2020, LREC 2020)

Zero -- A neural machine translation system

We present a list of languages with their codes, families, regions and etc. We also present a list of multi-lingual corpora (with urls).

Build a deep learning model for predicting the named entities from text.

中文文本分类实践，基于搜狗新闻语料库，采用传统机器学习方法以及预训练模型等方法

Поэтический корпус русского языка

No description or website provided.

Code for "Asynchronous bidirectional decoding for neural machine translation" (AAAI, 2018)

Repository for the experiments described in the paper named "DeepSentiPers: Novel Deep Learning Models Trained Over Proposed Augmented Persian Sentiment Corpus"

No description or website provided.

How Does Selective Mechanism Improve Self-attention Networks?

Neural machine translation implementation using dynet's python bindings

Open Discourse is the first fully comprehensive corpus of the plenary proceedings of the federal German Parliament (Bundestag).

Java JNI wrapper for SentencePiece: unsupervised text tokenizer for Neural Network-based text generation.

Kyoto University Web Document Leads Corpus

โครงการเก็บรวบรวมข่าวสารจากเว็บไซต์รัฐบาลไทย

MEV Data Corpus

An open-access corpus of conversational bilingual speech in Cantonese and English

An implementation of attention-based neural machine translation using Pytorch

My thesis on "Open Source Code and Low Resource Languages" for an MSc in Language Science and Technology at Saarland University

An Open-Source Package for Chinese Open-domain Conversational Chatbot (中文闲聊对话系统，一键部署微信闲聊机器人)

Python script to quickly create hand-crafted PDF files

A simple yet strong implementation of neural machine translation in pytorch

中文医疗信息处理基准CBLUE: A Chinese Biomedical Language Understanding Evaluation Benchmark

PubMed PICO Element Detection Dataset

A Public Corpus for Machine Learning

Fast corpus search engine originally made for the Corpus of Written Tatar language

A minimal nmt example to serve as an seq2seq+attention reference.

computer tools for thai language

A Fast Neural Machine Translation System. It is developed in C++ and resorts to NiuTensor for fast tensor APIs.

collect the open dialog corpus and some useful data processing utils.

No description or website provided.

Neutron: A pytorch based implementation of Transformer and its variants.

A meta-corpus of functional harmonic analysis.

CLUE Emotion Analysis Dataset 细粒度情感分析数据集

Text corpus for Bahasa Malaysia, https://malaya.readthedocs.io/en/latest/Dataset.html

Kanji usage frequency data collected from various sources

A greppable archive of ClojureScript code

Machine Translation (MT) Preparation Scripts

My fuzzing corpus

Tools for filtering and cleaning parallel and monolingual corpora for machine translation and other natural language processing tasks.

A multilingual parallel corpus created from translations of the Bible.

UPC Deep Learning for Speech and Language 2018

Neural Machine Translation on the Nepali-English language pair

Sign Language Translation with Transformers (COLING'2020, ECCV'20 SLRTP Workshop)

Text collections made available by the CLiGS group.

Visualization for simple attention and Google's multi-head attention.

Translating English sentences to Marathi using Neural Machine Translation

This repository contains the code, data, and models of the paper titled "XL-Sum: Large-Scale Multilingual Abstractive Summarization for 44 Languages" published in Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021.

Computer-generated poetry

extract relationships from standardized terms from corpus of interest with deep learning 🐟

物种名称语料库。植物名,动物名。

Data Augmentation for Neural Machine Translation