All Projects → charliememory → Disentangled Person Image Generation

charliememory / Disentangled Person Image Generation

Licence: mit
Tensorflow implementation of CVPR 2018 paper "Disentangled Person Image Generation"

Programming Languages

python
139335 projects - #7 most used programming language

Projects that are alternatives of or similar to Disentangled Person Image Generation

Lggan
[CVPR 2020] Local Class-Specific and Global Image-Level Generative Adversarial Networks for Semantic-Guided Scene Generation
Stars: ✭ 97 (-38.61%)
Mutual labels:  generative-model
Net2net
Network-to-Network Translation with Conditional Invertible Neural Networks
Stars: ✭ 120 (-24.05%)
Mutual labels:  generative-model
Semantic image inpainting
Semantic Image Inpainting
Stars: ✭ 140 (-11.39%)
Mutual labels:  generative-model
Spectralnormalizationkeras
Spectral Normalization for Keras Dense and Convolution Layers
Stars: ✭ 100 (-36.71%)
Mutual labels:  generative-model
Generative Evaluation Prdc
Code base for the precision, recall, density, and coverage metrics for generative models. ICML 2020.
Stars: ✭ 117 (-25.95%)
Mutual labels:  generative-model
Generative 3d Part Assembly
Generative 3D Part Assembly via Dynamic Graph Learning, NeurIPS 2020
Stars: ✭ 123 (-22.15%)
Mutual labels:  generative-model
Vae For Image Generation
Implemented Variational Autoencoder generative model in Keras for image generation and its latent space visualization on MNIST and CIFAR10 datasets
Stars: ✭ 87 (-44.94%)
Mutual labels:  generative-model
Msg Net
Multi-style Generative Network for Real-time Transfer
Stars: ✭ 152 (-3.8%)
Mutual labels:  generative-model
Torch Gqn
PyTorch Implementation of Generative Query Network
Stars: ✭ 118 (-25.32%)
Mutual labels:  generative-model
Gesturegan
[ACM MM 2018 Oral] GestureGAN for Hand Gesture-to-Gesture Translation in the Wild
Stars: ✭ 136 (-13.92%)
Mutual labels:  generative-model
Dmm
Deep Markov Models
Stars: ✭ 103 (-34.81%)
Mutual labels:  generative-model
Paysage
Unsupervised learning and generative models in python/pytorch.
Stars: ✭ 109 (-31.01%)
Mutual labels:  generative-model
Cramer Gan
Tensorflow Implementation on "The Cramer Distance as a Solution to Biased Wasserstein Gradients" (https://arxiv.org/pdf/1705.10743.pdf)
Stars: ✭ 123 (-22.15%)
Mutual labels:  generative-model
Giqa
Pytorch implementation of Generated Image Quality Assessment
Stars: ✭ 100 (-36.71%)
Mutual labels:  generative-model
Conditional Gan
Anime Generation
Stars: ✭ 141 (-10.76%)
Mutual labels:  generative-model
Rnn Handwriting Generation
Handwriting generation by RNN with TensorFlow, based on "Generating Sequences With Recurrent Neural Networks" by Alex Graves
Stars: ✭ 90 (-43.04%)
Mutual labels:  generative-model
Scgen
Single cell perturbation prediction
Stars: ✭ 122 (-22.78%)
Mutual labels:  generative-model
Stylegan2 Pytorch
Simplest working implementation of Stylegan2, state of the art generative adversarial network, in Pytorch. Enabling everyone to experience disentanglement
Stars: ✭ 2,656 (+1581.01%)
Mutual labels:  generative-model
Gretel Synthetics
Differentially private learning to create fake, synthetic datasets with enhanced privacy guarantees
Stars: ✭ 147 (-6.96%)
Mutual labels:  generative-model
First Order Model
This repository contains the source code for the paper First Order Motion Model for Image Animation
Stars: ✭ 11,964 (+7472.15%)
Mutual labels:  generative-model

Disentangled-Person-Image-Generation

Tensorflow implementation of CVPR 2018 paper Disentangled Person Image Generation

Two stages framework

Stage-I: reconstruction

Sampling phase

Dependencies

  • python 2.7
  • tensorflow-gpu (1.4.1)
  • numpy (1.14.0)
  • Pillow (5.0.0)
  • scikit-image (0.13.0)
  • scipy (1.0.1)
  • matplotlib (2.0.0)

Resources

TF-record data preparation steps

You can skip this data preparation procedure if directly using the tf-record data files.

  1. cd datasets
  2. ./run_convert_market.sh to download and convert the original images, poses, attributes, segmentations
  3. ./run_convert_DF.sh to download and convert the original images, poses
  4. [Optional] ./run_convert_RCV.sh to convert the original images and pose coordinates, i.e. (row, column, visibility) (e.g. from OpenPose or MaskRCNN), which can be useful for other datasets. Note: we also provide the convert code for Market-1501 Attribute and Market-1501 Segmentation results from PSPNet. These extra info. are provided for further research. In our experiments, pose mask are ontained from pose key-points (see _getPoseMask function in convert .py files).

Training steps

  1. Download the tf-record training data.
  2. Modify the log_dir and log_dir_pretrain in the run_market_train.sh/run_DF_train.sh scripts.
  3. run run_market_train.sh/run_DF_train.sh

Note: we use a triplet instead of pair real/fake for adversarial training to keep training more stable.

Testing steps

  1. Download the pretrained models and tf-record testing data.
  2. Modify the log_dir and log_dir_pretrain in the run_market_test.sh/run_DF_test.sh scripts.
  3. run run_market_test.sh/run_DF_test.sh

Fg/Bg/Pose sampling on Market-1501

Appearance sampling on DeepFashion dataset

Pose sampling on DeepFashion dataset

Pose interpolation between real images

  • Between same person:
  • Between different persons:

Pose guided person image generation

Citation

@inproceedings{ma2018disentangled,
  title={Disentangled Person Image Generation},
  author={Ma, Liqian and Sun, Qianru and Georgoulis, Stamatios and Van Gool, Luc and Schiele, Bernt and Fritz, Mario},
  booktitle={{IEEE} Conference on Computer Vision and Pattern Recognition},
  year={2018}
}

Related projects

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].