All Projects → anandpawara → Real_time_image_animation

anandpawara / Real_time_image_animation

Licence: gpl-3.0
The Project is real time application in opencv using first order model

Programming Languages

116507 projects - #7 most used programming language
Jupyter Notebook
8709 projects

Real time Image Animation

The Project is real time application in opencv using first order model

Steps to setup

Step 1: Create virtual environment

Python version : python v3.7.3 or higher

create virual environment : pip install virtualenv

activate virtual environment : virtualenv env

Step 2: Activate virtual environment

For windows : env/Script/activate

For Linux : source env/bin/activate

Step 3 : Install required modules

Install modules : pip install -r requirements.txt

Install pytorch and torchvision : pip install torch===1.0.0 torchvision===0.2.1 -f

Step 4 : Download cascade file ,weights and model and save in folder named extract

gdown --id 1wCzJP1XJNB04vEORZvPjNz6drkXm5AUK The file is also availible via direct link on Google's Drive:

On Linux machine : unzip

If on windows platfrom unzip using unzipping software like 7zip.

Delete zip file : rm

Step 5 : Run the project

Run application from live camera : python -i path_to_input_file -c path_to_checkpoint

Example : python .\ -i .\Inputs\Monalisa.png -c .\checkpoints\vox-cpk.pth.tar

Run application from video file : python -i path_to_input_file -c path_to_checkpoint -v path_to_video_file

Example : python .\ -i .\Inputs\Monalisa.png -c .\checkpoints\vox-cpk.pth.tar -v .\video_input\test1.mp4

test demo


Tkinter version

Need work on face alignments

Future plans adding deepfake voice and merging with video


  author={Siarohin, Aliaksandr and Lathuilière, Stéphane and Tulyakov, Sergey and Ricci, Elisa and Sebe, Nicu},
  title={First Order Motion Model for Image Animation},
  booktitle = {Conference on Neural Information Processing Systems (NeurIPS)},
  month = {December},
  year = {2019},
  url = {}
Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected]