All Projects → joonson → yousaidthat

joonson / yousaidthat

Licence: other
You Said That?: Synthesising Talking Faces from Audio

Programming Languages

matlab
3953 projects
Cuda
1817 projects
C++
36643 projects - #6 most used programming language
TeX
3793 projects
python
139335 projects - #7 most used programming language
shell
77523 projects

Prerequisites

ffmpeg
cuda (v8.0)

For face alignment:

scikit-image
dlib (v18.18)
numpy
scipy

Setting up Matconvnet

cd matconvnet_gen
addpath matlab
vl_compilenn('enableGpu', true, ...
               'cudaRoot', '/usr/local/cuda-8.0', ...
               'cudaMethod', 'nvcc') ;
vl_testnn('gpu', true)

Demo

Download model:

sh download_model.sh

Run demo in MATLAB:

run_demo

Face alignment

cd face_detection
y = baseface('../data/obama.jpg');

5 aligned identity images are then concatenated channel-wise. See faceimg.mat for examples.

Citation

Please cite the paper below if you make use of the demo.

@InProceedings{Chung17b,
  author       = "Chung, J.~S. and Jamaludin, A. and Zisserman, A.",
  title        = "You said that?",
  booktitle    = "British Machine Vision Conference",
  year         = "2017",
}
Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].