trigeorgis / Mdm
Licence: bsd-3-clause
A TensorFlow implementation of the Mnemonic Descent Method.
Stars: ✭ 120
Projects that are alternatives of or similar to Mdm
Azureml Bert
End-to-End recipes for pre-training and fine-tuning BERT using Azure Machine Learning Service
Stars: ✭ 342 (+185%)
Mutual labels: jupyter-notebook, pretrained-models
Face Pose Net
Estimate 3D face pose (6DoF) or 11 parameters of 3x4 projection matrix by a Convolutional Neural Network
Stars: ✭ 464 (+286.67%)
Mutual labels: face, face-alignment
Fbrs interactive segmentation
[CVPR2020] f-BRS: Rethinking Backpropagating Refinement for Interactive Segmentation https://arxiv.org/abs/2001.10331
Stars: ✭ 366 (+205%)
Mutual labels: jupyter-notebook, pretrained-models
DeepVTB
🌌 OpenVTuber-虚拟アイドル共享计划 An application of real-time face and gaze analyzation via deep nerual networks.
Stars: ✭ 32 (-73.33%)
Mutual labels: face, face-alignment
Facealignmentcompare
Empirical Study of Recent Face Alignment Methods
Stars: ✭ 15 (-87.5%)
Mutual labels: jupyter-notebook, face
Flame Fitting
Example code for the FLAME 3D head model. The code demonstrates how to sample 3D heads from the model, fit the model to 3D keypoints and 3D scans.
Stars: ✭ 269 (+124.17%)
Mutual labels: face, face-alignment
Fsgan
FSGAN - Official PyTorch Implementation
Stars: ✭ 420 (+250%)
Mutual labels: jupyter-notebook, face
Facelandmarksdetection
Finds facial features such as face contour, eyes, mouth and nose in an image.
Stars: ✭ 130 (+8.33%)
Mutual labels: snapchat, face
Breast cancer classifier
Deep Neural Networks Improve Radiologists' Performance in Breast Cancer Screening
Stars: ✭ 614 (+411.67%)
Mutual labels: jupyter-notebook, pretrained-models
Functional Zoo
PyTorch and Tensorflow functional model definitions
Stars: ✭ 577 (+380.83%)
Mutual labels: jupyter-notebook, pretrained-models
ARFaceFilter
Javascript/WebGL lightweight face tracking library designed for augmented reality webcam filters. Features : multiple faces detection, rotation, mouth opening. Various integration examples are provided (Three.js, Babylon.js, FaceSwap, Canvas2D, CSS3D...).
Stars: ✭ 72 (-40%)
Mutual labels: snapchat, face
Face-Recognition-FaceNet
A python script label faces in group photos using Facenet. 🎉
Stars: ✭ 21 (-82.5%)
Mutual labels: face, face-alignment
Autocrop
😌 Automatically detects and crops faces from batches of pictures.
Stars: ✭ 320 (+166.67%)
Mutual labels: jupyter-notebook, face
Jeelizfacefilter
Javascript/WebGL lightweight face tracking library designed for augmented reality webcam filters. Features : multiple faces detection, rotation, mouth opening. Various integration examples are provided (Three.js, Babylon.js, FaceSwap, Canvas2D, CSS3D...).
Stars: ✭ 2,042 (+1601.67%)
Mutual labels: snapchat, face
Bert Multitask Learning
BERT for Multitask Learning
Stars: ✭ 380 (+216.67%)
Mutual labels: jupyter-notebook, pretrained-models
Deep Face Recognition
One-shot Learning and deep face recognition notebooks and workshop materials
Stars: ✭ 147 (+22.5%)
Mutual labels: jupyter-notebook, face-alignment
Raspberrypi Facedetection Mtcnn Caffe With Motion
MTCNN with Motion Detection, on Raspberry Pi with Love
Stars: ✭ 204 (+70%)
Mutual labels: jupyter-notebook, face
Silero Models
Silero Models: pre-trained STT models and benchmarks made embarrassingly simple
Stars: ✭ 522 (+335%)
Mutual labels: jupyter-notebook, pretrained-models
Beauty.torch
Understanding facial beauty with deep learning.
Stars: ✭ 90 (-25%)
Mutual labels: jupyter-notebook, face
MDM
A Tensorflow implementation of the Mnemonic Descent Method.
Mnemonic Descent Method: A recurrent process applied for end-to-end face alignment
G. Trigeorgis, P. Snape, M. A. Nicolaou, E. Antonakos, S. Zafeiriou.
Proceedings of IEEE International Conference on Computer Vision & Pattern Recognition (CVPR'16).
Las Vegas, NV, USA, June 2016.
Installation Instructions
Menpo
We are an avid supporter of the Menpo project (http://www.menpo.org/) which we use in various ways throughout the implementation.
Please look at the installation instructions at:
http://www.menpo.org/installation/
TensorFlow
Follow the installation instructions of Tensorflow at and install it inside the conda enviroment you have created
https://www.tensorflow.org/versions/r0.9/get_started/os_setup.html#installing-from-sources
but use
git clone https://github.com/trigeorgis/tensorflow.git
as the TensorFlow repo. This is a fork of Tensorflow (#ff75787c) but it includes some extra C++ ops, such as for the extraction of patches around the landmarks.
Pretrained models
Disclaimer: The pretrained models can only be used for non-commercial academic purposes.
A pretrained model on 300W train set can be found at: https://www.doc.ic.ac.uk/~gt108/theano_mdm.pb
Training a model
Currently the TensorFlow implementation does not contain the same data augmnetation steps as we did in the paper, but this will be updated shortly.
# Activate the conda environment where tf/menpo resides.
source activate menpo
# Start training
python mdm_train.py --datasets='databases/lfpw/trainset/*.png:databases/afw/*.jpg:databases/helen/trainset/*.jpg'
# Track the train process and evaluate the current checkpoint against the validation set
python mdm_eval.py --dataset_path="./databases/ibug/*.jpg" --num_examples=135 --eval_dir=ckpt/eval_ibug --device='/cpu:0' --checkpoint_dir=$PWD/ckpt/train
python mdm_eval.py --dataset_path="./databases/lfpw/testset/*.png" --num_examples=300 --eval_dir=ckpt/eval_lfpw --device='/cpu:0' --checkpoint_dir=$PWD/ckpt/train
python mdm_eval.py --dataset_path="./databases/helen/testset/*.jpg" --num_examples=330 --eval_dir=ckpt/eval_helen --device='/cpu:0' --checkpoint_dir=$PWD/ckpt/train
# Run tensorboard to visualise the results
tensorboard --logdir==$PWD/ckpt
Note that the project description data, including the texts, logos, images, and/or trademarks,
for each open source project belongs to its rightful owner.
If you wish to add or remove any projects, please contact us at [email protected].