Top 72 speech-processing open source projects

The SpeechBrain project aims to build a novel speech toolkit fully based on PyTorch. With SpeechBrain users can easily create speech processing systems, ranging from speech recognition (both HMM/DNN and end-to-end), speaker recognition, speech enhancement, speech separation, multi-microphone speech processing, and many others.

Real-time GCC-NMF Blind Speech Separation and Enhancement

Implementation of Neural Voice Cloning with Few Samples Research Paper by Baidu

PyTorch implementation of VQ-VAE + WaveNet by [Chorowski et al., 2019] and VQ-VAE on speech signals by [van den Oord et al., 2017]

A React-Native Bridge for the Google Dialogflow (API.AI) SDK

Deep neural network based speech enhancement toolkit

VocGAN: A High-Fidelity Real-time Vocoder with a Hierarchically-nested Adversarial Network

Front-end speech processing aims at extracting proper features from short- term segments of a speech utterance, known as frames. It is a pre-requisite step toward any pattern recognition problem employing speech or audio (e.g., music). Here, we are interesting in voice disorder classification. That is, to develop two-class classifiers, which can discriminate between utterances of a subject suffering from say vocal fold paralysis and utterances of a healthy subject.The mathematical modeling of the speech production system in humans suggests that an all-pole system function is justified [1-3]. As a consequence, linear prediction coefficients (LPCs) constitute a first choice for modeling the magnitute of the short-term spectrum of speech. LPC-derived cepstral coefficients are guaranteed to discriminate between the system (e.g., vocal tract) contribution and that of the excitation. Taking into account the characteristics of the human ear, the mel-frequency cepstral coefficients (MFCCs) emerged as descriptive features of the speech spectral envelope. Similarly to MFCCs, the perceptual linear prediction coefficients (PLPs) could also be derived. The aforementioned sort of speaking tradi- tional features will be tested against agnostic-features extracted by convolu- tive neural networks (CNNs) (e.g., auto-encoders) [4]. The pattern recognition step will be based on Gaussian Mixture Model based classifiers,K-nearest neighbor classifiers, Bayes classifiers, as well as Deep Neural Networks. The Massachussets Eye and Ear Infirmary Dataset (MEEI-Dataset) [5] will be exploited. At the application level, a library for feature extraction and classification in Python will be developed. Credible publicly available resources will be 1used toward achieving our goal, such as KALDI. Comparisons will be made against [6-8].

This repo summarizes the tutorials, datasets, papers, codes and tools for speech separation and speaker extraction task. You are kindly invited to pull requests.

Tensorflow 2.x implementation of the DTLN real time speech denoising model. With TF-lite, ONNX and real-time audio processing support.

RETIRED - OpenSTT is now retired. If you would like more information on Mycroft AI's open source STT projects, please visit:

WaveNet vocoder

Collection of EM algorithms for blind source separation of audio signals

A minimum unofficial implementation of the "A Convolutional Recurrent Neural Network for Real-Time Speech Enhancement" (CRN) using PyTorch

PyTorch implementation of convolutional neural networks-based text-to-speech synthesis models

Tracking the progress in non-autoregressive generation (translation, transcription, etc.)

Neural speaker recognition/verification system based on Kaldi and Tensorflow

Deep Learning-based Voice Conversion system

Implement Wave-U-Net by PyTorch, and migrate it to the speech enhancement.

A light weight neural speaker embeddings extraction based on Kaldi and PyTorch.

Emotion recognition by speech in android.

A modified version of Speech Signal Processing Toolkit (SPTK)

ConvNets for Audio Recognition using Google Commands Dataset

Discriminative Neural Clustering for Speaker Diarisation

PyTorch implementation of "A Full-Band and Sub-Band Fusion Model for Real-Time Single-Channel Speech Enhancement."

Keras (tensorflow) implementation of SincNet (Mirco Ravanelli, Yoshua Bengio - https://github.com/mravanelli/SincNet)

iOS application for finding formants in spoken sounds

A implementation of Power Normalized Cepstral Coefficients: PNCC

Neural building blocks for speaker diarization: speech activity detection, speaker change detection, overlapped speech detection, speaker embedding

Natural Language Processing to generate new speeches for the President of Turkey.

SincNet is a neural architecture for efficiently processing raw audio samples.

Open source audio annotation tool for humans™

A curated list of awesome Speaker Diarization papers, libraries, datasets, and other resources.

A neural network for end-to-end speech denoising

Speech recognition toolkit for the arduino

Problem Agnostic Speech Encoder

Novoic's audio feature extraction library

Library to build speech synthesis systems designed for easy and fast prototyping.

A python wrapper for Speech Signal Processing Toolkit (SPTK).

This repository has implementation for "Neural Voice Cloning With Few Samples"

A tutorial for Speech Enhancement researchers and practitioners. The purpose of this repo is to organize the world’s resources for speech enhancement and make them universally accessible and useful.

Tracking the progress in end-to-end speech translation

HiFi-GAN: High Fidelity Denoising and Dereverberation Based on Speech Deep Features in Adversarial Networks

a neural network toolbox for animal vocalizations and bioacoustics

(1st place at HopHacks) A dynamic webVR memory palace for speech training, utilizing natural language processing and Google Streetview API

[wip]Speech recognition tool-box written by Nim. Based on Arraymancer.

Scripts for LIUM SpkDiarization tools

Reading list for research topics in multimodal machine learning

ttslearn: Library for Pythonで学ぶ音声合成 (Text-to-speech with Python)

UniSpeech - Large Scale Self-Supervised Learning for Speech

Combining Weighted Multi-resolution STFT Loss and Distance Fusion to Optimize Speech Enhancement Generative Adversarial Networks

python speech signal processing library

Book Library of P&W Studio

Spokestack: give your iOS app a voice interface!

A Convolutional Neural Network based Voice Activity Detector for Smartphones

This is the main repository of open-sourced speech technology by Huawei Noah's Ark Lab.

💎 A list of accessible speech corpora for ASR, TTS, and other Speech Technologies

Trained speaker embedding deep learning models and evaluation pipelines in pytorch and tesorflow for speaker recognition.

IEEE ICASSP 21 - Quantum Convolution Neural Networks for Speech Processing and Automatic Speech Recognition

A curated list of awesome Speech Enhancement papers, libraries, datasets, and other resources.