Cheap and reliable Node.js hosting starts at $3/month, and $1/month static HTML hosting

Use full GM set of musical instruments to play MIDI and single sounds or effects. Support for reverberation and equaliser. No plugins, no Flash. Pure HTML5 implementation compatible with desktop and mobile browser. See live examples.

Stars: ✭ 600 (-4.91%)

Mutual labels: audio

Audio Visualizer Android

🎵 [Android Library] A light-weight and easy-to-use Audio Visualizer for Android.

Stars: ✭ 581 (-7.92%)

Mutual labels: audio

Label Studio

Label Studio is a multi-type data labeling and annotation tool with standardized output format

Stars: ✭ 7,264 (+1051.19%)

Mutual labels: dataset

React Player

A React component for playing a variety of URLs, including file paths, YouTube, Facebook, Twitch, SoundCloud, Streamable, Vimeo, Wistia and DailyMotion

Stars: ✭ 5,931 (+839.94%)

Mutual labels: audio

Sonobus

Source code for SonoBus, a real-time network audio streaming collaboration tool.

Stars: ✭ 586 (-7.13%)

Mutual labels: audio

Green Recorder

A simple screen recorder for Linux desktop. Supports Wayland & Xorg

Stars: ✭ 594 (-5.86%)

Mutual labels: audio

Awesome chinese medical nlp

中文医学NLP公开资源整理：术语集/语料库/词向量/预训练模型/知识图谱/命名实体识别/QA/信息抽取/模型/论文/etc

Stars: ✭ 623 (-1.27%)

Mutual labels: dataset

View All Similar Projects ➔

ESC-50: Dataset for Environmental Sound Classification

Overview | Download | Results | Repository content | License | Citing | Caveats | Changelog

The ESC-50 dataset is a labeled collection of 2000 environmental audio recordings suitable for benchmarking methods of environmental sound classification.

The dataset consists of 5-second-long recordings organized into 50 semantical classes (with 40 examples per class) loosely arranged into 5 major categories:

_Animals	_{Natural soundscapes & water sounds}	_{Human, non-speech sounds}	_{Interior/domestic sounds}	_{Exterior/urban noises}
_Dog	_Rain	_{Crying baby}	_{Door knock}	_Helicopter
_Rooster	_{Sea waves}	_Sneezing	_{Mouse click}	_Chainsaw
_Pig	_{Crackling fire}	_Clapping	_{Keyboard typing}	_Siren
_Cow	_Crickets	_Breathing	_{Door, wood creaks}	_{Car horn}
_Frog	_{Chirping birds}	_Coughing	_{Can opening}	_Engine
_Cat	_{Water drops}	_Footsteps	_{Washing machine}	_Train
_Hen	_Wind	_Laughing	_{Vacuum cleaner}	_{Church bells}
_{Insects (flying)}	_{Pouring water}	_{Brushing teeth}	_{Clock alarm}	_Airplane
_Sheep	_{Toilet flush}	_Snoring	_{Clock tick}	_Fireworks
_Crow	_Thunderstorm	_{Drinking, sipping}	_{Glass breaking}	_{Hand saw}

Clips in this dataset have been manually extracted from public field recordings gathered by the Freesound.org project. The dataset has been prearranged into 5 folds for comparable cross-validation, making sure that fragments from the same original source file are contained in a single fold.

A more thorough description of the dataset is available in the original paper with some supplementary materials on GitHub: ESC: Dataset for Environmental Sound Classification - paper replication data.

Download

The dataset can be downloaded as a single .zip file (~600 MB):

Download ESC-50 dataset

Results

Numerous machine learning & signal processing approaches have been evaluated on the ESC-50 dataset. Most of them are listed here. If you know of some other reference, you can message me or open a Pull Request directly.

Terms used in the table:

_{• CNN - Convolutional Neural Network
• CRNN - Convolutional Recurrent Neural Network
• GMM - Gaussian Mixture Model
• GTCC - Gammatone Cepstral Coefficients
• GTSC - Gammatone Spectral Coefficients
• k-NN - k-Neareast Neighbors
• MFCC - Mel-Frequency Cepstral Coefficients
• MLP - Multi-Layer Perceptron
• RBM - Restricted Boltzmann Machine
• RNN - Recurrent Neural Network
• SVM - Support Vector Machine
• TEO - Teager Energy Operator
• ZCR - Zero-Crossing Rate}

_Title	_Notes	_Accuracy	_Paper	_Code
_{A Sequential Self Teaching Approach for Improving Generalization in Sound Event Recognition}	_{Multi-stage sequential learning with knowledge transfer from Audioset}	_94.10%	_kumar2020
_{Urban Sound Tagging using Multi-Channel Audio Feature with Convolutional Neural Networks}	_{Pretrained model with multi-channel features}	_89.50%	_kim2020	📜
_{An Ensemble of Convolutional Neural Networks for Audio Classification}	_{CNN ensemble with data augmentation}	_88.65%	_nanni2020	📜
_{Unsupervised Filterbank Learning Using Convolutional Restricted Boltzmann Machine for Environmental Sound Classification}	_{CNN with filterbanks learned using convolutional RBM + fusion with GTSC and mel energies}	_86.50%	_sailor2017
_{AclNet: efficient end-to-end audio classification CNN}	_{CNN with mixup and data augmentation}	_85.65%	_huang2018
_{On Open-Set Classification with L3-Net Embeddings for Machine Listening Applications}	_{x-vector network with openll3 embeddings}	_85.00%	_{wilkinghoff2020}
_{Learning from Between-class Examples for Deep Sound Recognition}	_{EnvNet-v2 (tokozume2017a) + data augmentation + Between-Class learning}	_84.90%	_{tokozume2017b}
_{Novel Phase Encoded Mel Filterbank Energies for Environmental Sound Classification}	_{CNN working with phase encoded mel filterbank energies (PEFBEs), fusion with Mel energies}	_84.15%	_tak2017
_{Knowledge Transfer from Weakly Labeled Audio using Convolutional Neural Network for Sound Events and Scenes}	_{CNN pretrained on AudioSet}	_83.50%	_kumar2017	📜
_{Unsupervised Filterbank Learning Using Convolutional Restricted Boltzmann Machine for Environmental Sound Classification}	_{CNN with filterbanks learned using convolutional RBM + fusion with GTSC}	_83.00%	_sailor2017
_{Deep Multimodal Clustering for Unsupervised Audiovisual Learning}	_{CNN + unsupervised audio-visual learning}	_82.60%	_hu2019
_{Novel TEO-based Gammatone Features for Environmental Sound Classification}	_{Fusion of GTSC & TEO-GTSC with CNN}	_81.95%	_agrawal2017
_{Learning from Between-class Examples for Deep Sound Recognition}	_{EnvNet-v2 (tokozume2017a) + Between-Class learning}	_81.80%	_{tokozume2017b}
🎧 _{Human accuracy}	_{Crowdsourcing experiment in classifying ESC-50 by human listeners}	_81.30%	_piczak2015a	📜
_{Objects that Sound}	_{Look, Listen and Learn (L3) network (arandjelovic2017a) with stride 2, larger batches and learning rate schedule}	_79.80%	_{arandjelovic2017b}
_{Look, Listen and Learn}	_{8-layer convolutional subnetwork pretrained on an audio-visual correspondence task}	_79.30%	_{arandjelovic2017a}
_{Learning Environmental Sounds with Multi-scale Convolutional Neural Network}	_{Multi-scale convolutions with feature fusion (waveform + spectrogram)}	_79.10%	_zhu2018
_{Novel TEO-based Gammatone Features for Environmental Sound Classification}	_{GTSC with CNN}	_79.10%	_agrawal2017
_{Learning from Between-class Examples for Deep Sound Recognition}	_{EnvNet-v2 (tokozume2017a) + data augmentation}	_78.80%	_{tokozume2017b}
_{Unsupervised Filterbank Learning Using Convolutional Restricted Boltzmann Machine for Environmental Sound Classification}	_{CNN with filterbanks learned using convolutional RBM}	_78.45%	_sailor2017
_{Learning from Between-class Examples for Deep Sound Recognition}	_{Baseline CNN (piczak2015b) + Batch Normalization + Between-Class learning}	_76.90%	_{tokozume2017b}
_{Novel TEO-based Gammatone Features for Environmental Sound Classification}	_{TEO-GTSC with CNN}	_74.85%	_agrawal2017
_{Learning from Between-class Examples for Deep Sound Recognition}	_{EnvNet-v2 (tokozume2017a)}	_74.40%	_{tokozume2017b}
_{Soundnet: Learning sound representations from unlabeled video}	_{8-layer CNN (raw audio) with transfer learning from unlabeled videos}	_74.20%	_aytar2016	📜
_{Learning from Between-class Examples for Deep Sound Recognition}	_{18-layer CNN on raw waveforms (dai2016) + Between-Class learning}	_73.30%	_{tokozume2017b}
_{Novel Phase Encoded Mel Filterbank Energies for Environmental Sound Classification}	_{CNN working with phase encoded mel filterbank energies (PEFBEs)}	_73.25%	_tak2017
_{Classifying environmental sounds using image recognition networks}	_{16 kHz sampling rate, GoogLeNet on spectrograms (40 ms frame length)}	_73.20%	_{boddapati2017}	📜
_{Learning from Between-class Examples for Deep Sound Recognition}	_{Baseline CNN (piczak2015b) + Batch Normalization}	_72.40%	_{tokozume2017b}
_{Novel TEO-based Gammatone Features for Environmental Sound Classification}	_{Fusion of MFCC & TEO-GTCC with GMM}	_72.25%	_agrawal2017
_{Learning environmental sounds with end-to-end convolutional neural network (EnvNet)}	_{Combination of spectrogram and raw waveform CNN}	_71.00%	_{tokozume2017a}
_{Novel TEO-based Gammatone Features for Environmental Sound Classification}	_{TEO-GTCC with GMM}	_68.85%	_agrawal2017
_{Classifying environmental sounds using image recognition networks}	_{16 kHz sampling rate, AlexNet on spectrograms (30 ms frame length)}	_68.70%	_{boddapati2017}	📜
_{Very Deep Convolutional Neural Networks for Raw Waveforms}	_{18-layer CNN on raw waveforms}	_68.50%	_{dai2016, tokozume2017b}	📜
_{Classifying environmental sounds using image recognition networks}	_{32 kHz sampling rate, GoogLeNet on spectrograms (30 ms frame length)}	_67.80%	_{boddapati2017}	📜
_{WSNet: Learning Compact and Efficient Networks with Weight Sampling}	_{SoundNet 8-layer CNN architecture with 100x model compression}	_66.25%	_jin2017
_{Soundnet: Learning sound representations from unlabeled video}	_{5-layer CNN (raw audio) with transfer learning from unlabeled videos}	_66.10%	_aytar2016	📜
_{WSNet: Learning Compact and Efficient Networks with Weight Sampling}	_{SoundNet 8-layer CNN architecture with 180x model compression}	_65.80%	_jin2017
_{Soundnet: Learning sound representations from unlabeled video}	_{5-layer CNN trained on raw audio of ESC-50 only}	_65.00%	_aytar2016	📜
_{📊 Environmental Sound Classification with Convolutional Neural Networks - CNN baseline}	_{CNN with 2 convolutional and 2 fully-connected layers, mel-spectrograms as input, vertical filters in the first layer}	_64.50%	_piczak2015b	📜
_{auDeep: Unsupervised Learning of Representations from Audio with Deep Recurrent Neural Networks}	_{MLP classifier on features extracted with an RNN autoencoder}	_64.30%	_freitag2017	📜
_{Classifying environmental sounds using image recognition networks}	_{32 kHz sampling rate, AlexNet on spectrograms (30 ms frame length)}	_63.20%	_{boddapati2017}	📜
_{Classifying environmental sounds using image recognition networks}	_CRNN	_60.30%	_{boddapati2017}	📜
_{Comparison of Time-Frequency Representations for Environmental Sound Classification using Convolutional Neural Networks}	_{3-layer CNN with vertical filters on wideband mel-STFT (median accuracy)}	_56.37%	_huzaifah2017
_{Comparison of Time-Frequency Representations for Environmental Sound Classification using Convolutional Neural Networks}	_{3-layer CNN with square filters on wideband mel-STFT (median accuracy)}	_54.00%	_huzaifah2017
_{Soundnet: Learning sound representations from unlabeled video}	_{8-layer CNN trained on raw audio of ESC-50 only}	_51.10%	_aytar2016	📜
_{Comparison of Time-Frequency Representations for Environmental Sound Classification using Convolutional Neural Networks}	_{5-layer CNN with square filters on wideband mel-STFT (median accuracy)}	_50.87%	_huzaifah2017
_{Comparison of Time-Frequency Representations for Environmental Sound Classification using Convolutional Neural Networks}	_{5-layer CNN with vertical filters on wideband mel-STFT (median accuracy)}	_46.25%	_huzaifah2017
📊 _{Baseline - random forest}	_{Baseline ML approach (MFCC & ZCR + random forest)}	_44.30%	_piczak2015a	📜
_{Soundnet: Learning sound representations from unlabeled video}	_{Convolutional autoencoder trained on unlabeled videos}	_39.90%	_aytar2016	📜
📊 _{Baseline - SVM}	_{Baseline ML approach (MFCC & ZCR + SVM)}	_39.60%	_piczak2015a	📜
📊 _{Baseline - k-NN}	_{Baseline ML approach (MFCC & ZCR + k-NN)}	_32.20%	_piczak2015a	📜
_{A mixture model-based real-time audio sources classification method}	_{Dictionary of sound models used for classification (accuracy is computed on segments instead of files)}	_94.00%	_baelde2017
_{NELS - Never-Ending Learner of Sounds}	_{Large-scale audio crawling with classifiers trained on AED datasets (including ESC-50)}	_N/A	_elizalde2017	📜
_{Utilizing Domain Knowledge in End-to-End Audio Processing}	_{End-to-end CNN with learned mel-spectrogram transformation}	_N/A	_tax2017	📜
_{Deep Neural Network based learning and transferring mid-level audio features for acoustic scene classification}	_{Transfer learning from various datasets, including ESC-50}	_N/A	_mun2017
_{Features and Kernels for Audio Event Recognition}	_{MFCC, GMM, SVM}	_N/A	_kumar2016b
_{A real-time environmental sound recognition system for the Android OS}	_{Real-time sound recognition for Android evaluated on ESC-10}	_N/A	_pillos2016
_{Comparing Time and Frequency Domain for Audio Event Recognition Using Deep Learning}	_{Discriminatory effectiveness of different signal representations compared on ESC-10 and Freiburg-106}	_N/A	_hertel2016
_{Audio Event and Scene Recognition: A Unified Approach using Strongly and Weakly Labeled Data}	_{Combination of weakly labeled data (YouTube) with strong labeling (ESC-10) for Acoustic Event Detection}	_N/A	_kumar2016a

Repository content

audio/*.wav

2000 audio recordings in WAV format (5 seconds, 44.1 kHz, mono) with the following naming convention:

{FOLD}-{CLIP_ID}-{TAKE}-{TARGET}.wav
- {FOLD} - index of the cross-validation fold,
- {CLIP_ID} - ID of the original Freesound clip,
- {TAKE} - letter disambiguating between different fragments from the same Freesound clip,
- {TARGET} - class in numeric format [0, 49].
meta/esc50.csv

CSV file with the following structure:

_filename _fold _target _category _esc10 _{src_file} _take

The esc10 column indicates if a given file belongs to the ESC-10 subset (10 selected classes, CC BY license).
meta/esc50-human.xlsx

Additional data pertaining to the crowdsourcing experiment (human classification accuracy).

License

The dataset is available under the terms of the Creative Commons Attribution Non-Commercial license.

A smaller subset (clips tagged as ESC-10) is distributed under CC BY (Attribution).

Attributions for each clip are available in the LICENSE file.

Citing

If you find this dataset useful in an academic setting please cite:

K. J. Piczak. ESC: Dataset for Environmental Sound Classification. Proceedings of the 23rd Annual ACM Conference on Multimedia, Brisbane, Australia, 2015.

[DOI: http://dx.doi.org/10.1145/2733373.2806390]

@inproceedings{piczak2015dataset,
  title = {{ESC}: {Dataset} for {Environmental Sound Classification}},
  author = {Piczak, Karol J.},
  booktitle = {Proceedings of the 23rd {Annual ACM Conference} on {Multimedia}},
  date = {2015-10-13},
  url = {http://dl.acm.org/citation.cfm?doid=2733373.2806390},
  doi = {10.1145/2733373.2806390},
  location = {{Brisbane, Australia}},
  isbn = {978-1-4503-3459-4},
  publisher = {{ACM Press}},
  pages = {1015--1018}
}

Caveats

Please be aware of potential information leakage while training models on ESC-50, as some of the original Freesound recordings were already preprocessed in a manner that might be class dependent (mostly bandlimiting). Unfortunately, this issue went unnoticed when creating the original version of the dataset. Due to the number of methods already evaluated on ESC-50, no changes rectifying this issue will be made in order to preserve comparability.

Changelog

v2.0.0 (2017-12-13)

_{• Change to WAV version as default.}

v2.0.0-pre (2016-10-10) (wav-files branch)

_{• Replace OGG recordings with cropped WAV files for easier loading and frame-level precision (some of the OGG recordings had a slightly different length when loaded).
• Move recordings to a one directory structure with a meta CSV file.}

v1.0.0 (2015-04-15)

_{• Initial version of the dataset (OGG format).}

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].

Stars: ✭ 631

Visit Git Page 🔗Visit User Page 🔗Visit Issues Page (1) 🔗