Music-and-Culture-Technology-Lab / Omnizart

Licence: mit
Omniscient Mozart, being able to transcribe everything in the music, including vocal, drum, chord, beat, instruments, and more.

Programming Languages

python
139335 projects - #7 most used programming language

Projects that are alternatives of or similar to Omnizart

Msaf
Music Structure Analysis Framework
Stars: ✭ 297 (+80%)
Mutual labels:  music-information-retrieval
Vocal Melody Extraction
Source code for "Vocal melody extraction with semantic segmentation and audio-symbolic domain transfer learning".
Stars: ✭ 44 (-73.33%)
Mutual labels:  music-information-retrieval
Genius
Easily access song lyrics from Genius in a tibble.
Stars: ✭ 111 (-32.73%)
Mutual labels:  music-information-retrieval
Madmom
Python audio and music signal processing library
Stars: ✭ 728 (+341.21%)
Mutual labels:  music-information-retrieval
Alignmentduration
Lyrics-to-audio-alignement system. Based on Machine Learning Algorithms: Hidden Markov Models with Viterbi forced alignment. The alignment is explicitly aware of durations of musical notes. The phonetic model are classified with MLP Deep Neural Network.
Stars: ✭ 36 (-78.18%)
Mutual labels:  music-information-retrieval
Aca Code
Matlab scripts accompanying the book "An Introduction to Audio Content Analysis" (www.AudioContentAnalysis.org)
Stars: ✭ 67 (-59.39%)
Mutual labels:  music-information-retrieval
Spotifyr
R wrapper for Spotify's Web API
Stars: ✭ 258 (+56.36%)
Mutual labels:  music-information-retrieval
Audioowl
Fast and simple music and audio analysis using RNN in Python 🕵️‍♀️ 🥁
Stars: ✭ 151 (-8.48%)
Mutual labels:  music-information-retrieval
Strugatzki
Algorithms for matching audio file similarities. Mirror of https://git.iem.at/sciss/Strugatzki
Stars: ✭ 38 (-76.97%)
Mutual labels:  music-information-retrieval
Fma
FMA: A Dataset For Music Analysis
Stars: ✭ 1,391 (+743.03%)
Mutual labels:  music-information-retrieval
Meyda
Audio feature extraction for JavaScript.
Stars: ✭ 792 (+380%)
Mutual labels:  music-information-retrieval
Musicinformationretrieval.com
Instructional notebooks on music information retrieval.
Stars: ✭ 845 (+412.12%)
Mutual labels:  music-information-retrieval
Symbolic Musical Datasets
🎹 symbolic musical datasets
Stars: ✭ 79 (-52.12%)
Mutual labels:  music-information-retrieval
Crepe
CREPE: A Convolutional REpresentation for Pitch Estimation -- pre-trained model (ICASSP 2018)
Stars: ✭ 514 (+211.52%)
Mutual labels:  music-information-retrieval
Essentia
C++ library for audio and music analysis, description and synthesis, including Python bindings
Stars: ✭ 1,985 (+1103.03%)
Mutual labels:  music-information-retrieval
Essentia.js
JavaScript library for music/audio analysis and processing powered by Essentia WebAssembly
Stars: ✭ 294 (+78.18%)
Mutual labels:  music-information-retrieval
Music Synthesis With Python
Music Synthesis with Python talk, originally given at PyGotham 2017.
Stars: ✭ 48 (-70.91%)
Mutual labels:  music-information-retrieval
Omr Datasets
Collection of datasets used for Optical Music Recognition
Stars: ✭ 158 (-4.24%)
Mutual labels:  music-information-retrieval
Muspy
A toolkit for symbolic music generation
Stars: ✭ 151 (-8.48%)
Mutual labels:  music-information-retrieval
Mad Twinnet
The code for the MaD TwinNet. Demo page:
Stars: ✭ 99 (-40%)
Mutual labels:  music-information-retrieval

OMNIZART

build docs PyPI version PyPI - License PyPI - Downloads Docker Pulls

Omnizart is a Python library that aims for democratizing automatic music transcription. Given polyphonic music, it is able to transcribe pitched instruments, vocal melody, chords, drum events, and beat. This is powered by the research outcomes from Music and Culture Technology (MCT) Lab.

Transcribe your favorite songs now in Colab! Open In Colab

Quick start

Visit the complete document for detailed guidance.

Pip

# Install omnizart
pip install omnizart

# Download the checkpoints
omnizart download-checkpoints

# Transcribe your songs
omnizart drum transcribe <path/to/audio.wav>
omnizart chord transcribe <path/to/audio.wav>
omnizart music transcribe <path/to/audio.wav>

Docker

docker pull mctlab/omnizart:latest
docker run -it mctlab/omnizart:latest bash

Supported applications

Application Transcription Training Evaluation Description
music ✔️ ✔️ Transcribe musical notes of pitched instruments.
drum ✔️ ⁉️ Transcribe events of percussive instruments.
vocal ✔️ ✔️ Transcribe note-level vocal melody.
vocal-contour ✔️ ✔️ Transcribe frame-level vocal melody (F0).
chord ✔️ ✔️ Transcribe chord progressions.
beat ✔️ ✔️ Transcribe beat position.

NOTES The current implementation for the drum model has unknown bugs, preventing loss convergence when training from scratch. Fortunately, you can still enjoy drum transcription with the provided checkpoints.

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].