All Projects → thepowerfuldeez → Facemesh.pytorch

thepowerfuldeez / Facemesh.pytorch

Licence: apache-2.0
This is the PyTorch implementation of paper Real-time Facial Surface Geometry from Monocular Video on Mobile GPUs (https://arxiv.org/pdf/1907.06724.pdf)

Projects that are alternatives of or similar to Facemesh.pytorch

Codesearchnet
Datasets, tools, and benchmarks for representation learning of code.
Stars: ✭ 1,378 (+1264.36%)
Mutual labels:  jupyter-notebook
Keras Openpose Reproduce
Keras implementation of Realtime Multi-Person Pose Estimation
Stars: ✭ 102 (+0.99%)
Mutual labels:  jupyter-notebook
Loads clustering
Data Science project to cluster loads coming from http://en.openei.org/datasets/files/961/pub/
Stars: ✭ 102 (+0.99%)
Mutual labels:  jupyter-notebook
Hackermath
Introduction to Statistics and Basics of Mathematics for Data Science - The Hacker's Way
Stars: ✭ 1,380 (+1266.34%)
Mutual labels:  jupyter-notebook
Hic Data Analysis Bootcamp
Workshop on measuring, analyzing, and visualizing the 3D genome with Hi-C data.
Stars: ✭ 102 (+0.99%)
Mutual labels:  jupyter-notebook
Dlschl
Stars: ✭ 103 (+1.98%)
Mutual labels:  jupyter-notebook
Hands On Data Science For Marketing
Hands-On Data Science for Marketing, published by Packt
Stars: ✭ 102 (+0.99%)
Mutual labels:  jupyter-notebook
End To End Time Series
This repository hosts code for my Time Series videos part of playlist here - https://www.youtube.com/playlist?list=PL3N9eeOlCrP5cK0QRQxeJd6GrQvhAtpBK
Stars: ✭ 103 (+1.98%)
Mutual labels:  jupyter-notebook
Dataminingnotesandpractice
记录我学习数据挖掘过程的笔记和见到的奇技,持续更新~
Stars: ✭ 103 (+1.98%)
Mutual labels:  jupyter-notebook
Sst
SST: Single-Stream Temporal Action Proposals (Official Repo)
Stars: ✭ 102 (+0.99%)
Mutual labels:  jupyter-notebook
Keras Oneclassanomalydetection
[5 FPS - 150 FPS] Learning Deep Features for One-Class Classification (AnomalyDetection). Corresponds RaspberryPi3. Convert to Tensorflow, ONNX, Caffe, PyTorch. Implementation by Python + OpenVINO/Tensorflow Lite.
Stars: ✭ 102 (+0.99%)
Mutual labels:  jupyter-notebook
Storytelling With Data
Plots from the book "Storytelling with data" implementation using Python and matplotlib
Stars: ✭ 100 (-0.99%)
Mutual labels:  jupyter-notebook
Scipy2017 Jupyter Widgets Tutorial
Notebooks for the SciPy 2017 tutorial "The Jupyter Interactive Widget Ecosystem"
Stars: ✭ 102 (+0.99%)
Mutual labels:  jupyter-notebook
Irkernel
R kernel for Jupyter
Stars: ✭ 1,379 (+1265.35%)
Mutual labels:  jupyter-notebook
Pokelyzer
A webhook listener and database schema for doing geospatial analysis and advanced analytics on Pokemon Go data.
Stars: ✭ 102 (+0.99%)
Mutual labels:  jupyter-notebook
Mediumposts
Stars: ✭ 102 (+0.99%)
Mutual labels:  jupyter-notebook
Models
DLTK Model Zoo
Stars: ✭ 101 (+0%)
Mutual labels:  jupyter-notebook
Deep ctr
Stars: ✭ 102 (+0.99%)
Mutual labels:  jupyter-notebook
Advanced Machine Learning With Python
Code repository for Advanced Machine Learning with Python, published by Packt
Stars: ✭ 102 (+0.99%)
Mutual labels:  jupyter-notebook
Tsa
The Thalesians' Time Series Analysis (TSA) library
Stars: ✭ 102 (+0.99%)
Mutual labels:  jupyter-notebook

This is the PyTorch implementation of paper Real-time Facial Surface Geometry from Monocular Video on Mobile GPUs (https://arxiv.org/pdf/1907.06724.pdf)

This version doesn't have BatchNorm layers for fine-tuning. If you want to use such model for training, you should add these layers manually.

The procedure for conversion was pretty interesting:

  1. I unpacked ARCore iOS framework and took tflite model of facemesh. You can download it here
  2. Paper doesn't state any architecture details, so I looked at Netron graph visualization to reverse-engineer number of input-output channels and operations.
  3. Made them in pytorch and transfer raw weights from tflite file semi-manually into pytorch model definition. (see Convert-FaceMesh.ipynb for details)

Input for the model is expected to be cropped face with 25% margin at every side, resized to 192x192 and normalized from -1 to 1

However, predict_on_image function normalizes your image itself, so you can even treat resized image as np.array as input

See Inference-FaceMesh.ipynb notebook for usage example

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].