All Projects → LuisKay → Spec_ResNet

LuisKay / Spec_ResNet

Licence: other
Spectrogram is selected as preprocessing feature of audio clips and a feature representation method based on deep residual network (Spec-ResNet) is proposed to detect audio steganography.

Programming Languages

python
139335 projects - #7 most used programming language

Projects that are alternatives of or similar to Spec ResNet

sonopy
A simple audio feature extraction library
Stars: ✭ 72 (+242.86%)
Mutual labels:  spectrogram
spectral connectivity
Frequency domain estimation and functional and directed connectivity analysis tools for electrophysiological data
Stars: ✭ 57 (+171.43%)
Mutual labels:  spectrogram
AudioNet
Audio Classification using Image Classification
Stars: ✭ 46 (+119.05%)
Mutual labels:  spectrogram
ultimatevocalremovergui
GUI for a Vocal Remover that uses Deep Neural Networks.
Stars: ✭ 370 (+1661.9%)
Mutual labels:  spectrogram
spectrogram
Taking an audio signal (wav) and converting it into a spectrogram. Written in Go programming language.
Stars: ✭ 34 (+61.9%)
Mutual labels:  spectrogram
VoiceNET.Library
.NET library to easily create Voice Command Control feature.
Stars: ✭ 14 (-33.33%)
Mutual labels:  spectrogram
spectrogram-tutorial
A walkthrough of how to make spectrograms in python that are customized for human speech research.
Stars: ✭ 31 (+47.62%)
Mutual labels:  spectrogram
FftSharp
A .NET Standard library for computing the Fast Fourier Transform (FFT) of real or complex data
Stars: ✭ 132 (+528.57%)
Mutual labels:  spectrogram
equalizer
SoundCloud music player with equalizer
Stars: ✭ 25 (+19.05%)
Mutual labels:  spectrogram
SpleeterRT
Real time monaural source separation base on fully convolutional neural network operates on Time-frequency domain.
Stars: ✭ 111 (+428.57%)
Mutual labels:  spectrogram
Sound-based-bird-species-detection
Sound-based Bird Classification - using AI, acoustics and ornithology to classify birds in the environment, an environmental awareness project (Web Application, Flask, Python)
Stars: ✭ 56 (+166.67%)
Mutual labels:  spectrogram
bird-species-classification
Using convolutional neural networks to build and train a bird species classifier on bird song data with corresponding species labels.
Stars: ✭ 90 (+328.57%)
Mutual labels:  deep-residual-network

Spec_ResNet

Spectrogram is selected as preprocessing feature of audio samples and a feature representation method based on deep residual network (Spec-ResNet) is implemented here to detect audio steganography based on AAC(Advanced Audio Coding) and MP3(MPEG-1 Audio Layer III).

First of all, we analysed existing audio steganography based on AAC and MP3. Although the embedding domain is different, the final impact of existing schemes are the subtle modifications of MDCT coefficients of the encoded audio signals in different frequency range. Spectrogram, a basic visual representation of the spectrum of frequencies of audio signals which can show energy amplitude information of different frequency bands over time and contains abundant time-frequency information about the audio signal.

Still, this is a work on progress, we will update it lately. You will find responding paper "Spec-ResNet: A General Audio Steganalysis scheme based on Deep Residual Network of Spectrogram" by Yanzhen Ren, Dengkai Liu, Qiaochu Xiong, Jianming Fu, Lina Wang in https://arxiv.org/abs/1901.06838.

Requirements

  • Tensorflow 1.0.0
  • CUDA 8.0.61
  • CuDNN 5.1.10
  • Python 2.7.15.

Data set

  • In-house build dataset

    • stego with 5 relative embedding rate for AAC is provided. (2s, stereo, 1024Kbps, decoded WAV)

      • lsb_ee (0.1, 0.2, 0.3, 0.5, 1.0)
      • min (0.1, 0.2, 0.3, 0.5, 1.0)
      • sign (0.1, 0.2, 0.3, 0.5, 1.0)
    • stego with approximately maxium embedding capcity for Mp3Stego is provided.(5s, mono, 705Kbps, decoded wav)

      spectrogram feature extraction script is in AAC (2s, stereo, 1024Kbps, decoded WAV).rar together with a small sample subset, whose spectrogram matrix with window size N=512 in Spectrogram.rar.

  • ASDIIE(extract code: z28d)

Experiments

For AAC based steganographic algorithm, we choosed above three as objects. Considering the capicity of MP3stego, we choosed several emerging MP3 adaptive steganography(AHCM, EECS) with distortion minimization and UnderMp3Cover to test the detection ability. The dataset we choose was also changed. It wil be coming soon...

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].