GitPlanet

Cheap and reliable Node.js hosting starts at $3/month, and $1/month static HTML hosting

Created with love in Canada, visit hostnodejs.com today

Feel like to post an Ad? Learn Details
All Projects → shaoanlu → Audio2Guitarist-GAN

shaoanlu / Audio2Guitarist-GAN

Licence: other
Two-stage GANs that generate fingerstyle guitarist images from audio.

Labels

deep-learningguitargenerative-adversarial-networkgancross-domainaudio-to-image

Projects that are alternatives of or similar to Audio2Guitarist-GAN

GraphCNN-GAN
Graph-convolutional GAN for point cloud generation. Code from ICLR 2019 paper Learning Localized Generative Models for 3D Point Clouds via Graph Convolution
Stars: ✭ 50 (-5.66%)
Mutual labels:  generative-adversarial-network
PostEvent
A Cross-Domain Event Handler javascript library. Pure Vanilla JS, no dependencies.
Stars: ✭ 14 (-73.58%)
Mutual labels:  cross-domain
stylegan-encoder
StyleGAN Encoder - converts real images to latent space
Stars: ✭ 694 (+1209.43%)
Mutual labels:  generative-adversarial-network
SSVEP-Neural-Generative-Models
Code to accompany our International Joint Conference on Neural Networks (IJCNN) paper entitled - Simulating Brain Signals: Creating Synthetic EEG Data via Neural-Based Generative Models for Improved SSVEP Classification
Stars: ✭ 37 (-30.19%)
Mutual labels:  generative-adversarial-network
tabs
Guitar tabs transcribed by me, primarily in the stoner/doom/sludge metal genres... plus a few random other things.
Stars: ✭ 34 (-35.85%)
Mutual labels:  guitar
Awesome-GAN-Resources
🤖A list of resources to help anyone getting started with GANs 🤖
Stars: ✭ 90 (+69.81%)
Mutual labels:  generative-adversarial-network
gzsl-od
Out-of-Distribution Detection for Generalized Zero-Shot Action Recognition
Stars: ✭ 47 (-11.32%)
Mutual labels:  generative-adversarial-network
keras-text-to-image
Translate text to image in Keras using GAN and Word2Vec as well as recurrent neural networks
Stars: ✭ 60 (+13.21%)
Mutual labels:  generative-adversarial-network
Articles-Bookmarked
No description or website provided.
Stars: ✭ 30 (-43.4%)
Mutual labels:  generative-adversarial-network
videoDCGAN
Implementation of a GAN that generates video using LSTM and ConvNet in Tensorflow
Stars: ✭ 14 (-73.58%)
Mutual labels:  generative-adversarial-network
Easter-Bootcamp-2018
Designed to take you from zero experience to GANs within a week.
Stars: ✭ 24 (-54.72%)
Mutual labels:  generative-adversarial-network
Cross-Domain-Image-Translation-Using-CycleGAN
CycleGAN based neural network architecture to change the gender of a person’s face
Stars: ✭ 15 (-71.7%)
Mutual labels:  generative-adversarial-network
gan-error-avoidance
Learning to Avoid Errors in GANs by Input Space Manipulation (Code for paper)
Stars: ✭ 23 (-56.6%)
Mutual labels:  generative-adversarial-network
DeepEcho
Synthetic Data Generation for mixed-type, multivariate time series.
Stars: ✭ 44 (-16.98%)
Mutual labels:  generative-adversarial-network
pytorch-domain-adaptation
Unofficial pytorch implementation of algorithms for domain adaptation
Stars: ✭ 24 (-54.72%)
Mutual labels:  generative-adversarial-network
iframe-communication
Basic two way iframe communication
Stars: ✭ 88 (+66.04%)
Mutual labels:  cross-domain
AGD
[ICML2020] "AutoGAN-Distiller: Searching to Compress Generative Adversarial Networks" by Yonggan Fu, Wuyang Chen, Haotao Wang, Haoran Li, Yingyan Lin, Zhangyang Wang
Stars: ✭ 98 (+84.91%)
Mutual labels:  generative-adversarial-network
favorite-research-papers
Listing my favorite research papers 📝 from different fields as I read them.
Stars: ✭ 12 (-77.36%)
Mutual labels:  generative-adversarial-network
Adversarial-Learning-for-Generative-Conversational-Agents
This repository contains a new adversarial training method for Generative Conversational Agents
Stars: ✭ 71 (+33.96%)
Mutual labels:  generative-adversarial-network
WGAN-GP-tensorflow
Tensorflow Implementation of Paper "Improved Training of Wasserstein GANs"
Stars: ✭ 23 (-56.6%)
Mutual labels:  generative-adversarial-network
View All Similar Projects ➔

Audio2Guitarist-GAN

A two-stage generative adversarial network that generates images of guitarists playing guitar from audio.

a2g_gif

Descriptions

To be updated.

Architecture

Stage 1: Audio to binary mask  

stage1_arch

Stage 2: Binary mask to color image

 stage2_arch

More information in this blog post.

Result

1. Video output

Here are the official website of 南澤大介 and 伍々慧.

2. Conditional output

The following gifs are result images generated from an audio that the model had never seen.

blue olive wine

3. Pose-guided generation

The following gifs show outputs of 2nd-stage model given conditional poses.

JP_guided_pose1 JP_guided_pose2

References

  1. Audio to Body Dynamics
  2. Pose guided person image generation
  3. Deep Video Generation, Prediction and Completion of Human Action Sequences
  4. Deformable GANs for Pose-based Human Image Generation
  5. Skeleton-aided Articulated Motion Generation
  6. Assessment of Student Music Performances Using Deep Neural Networks
  7. Dance Dance Convolution
Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].