Human Pose Estimation from RGB Camera - The repo

In recent years, tremendous amount of progress is being made in the field of Human Pose Estimation from RGB Camera, which is an interdisciplinary field that fuses computer vision, deep/machine learning and anatomy. This repo is for my study notes and will be used as a place for triaging new research papers.

Get Involved

To make it a collaborative project, you may add content through pull requests or open an issue to let me know.

Table of Contents

I'll use the following icons and dimensions to differentiate the approaches:

• Time Dimension
  • 📷 Single-Shot
  • 🎥 Video/Real-Time
• Number of People
  • 1️⃣ Single-Person
  • 🔢 Multi-Person
• Spatial Dimensions
  • 2D Models
  • 3D Models

Projects and papers

2D Models

🎥🔢 Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields (2017) [Project page][Paper]

📷1️⃣ Stacked Hourglass Networks for Human Pose Estimation (2016) [Paper]

📷1️⃣ Convolutional Pose Machines (2016) [Paper]

📷1️⃣ Adversarial PoseNet: A Structure-aware Convolutional Network for Human Pose Estimation (2017) [Paper]

📷1️⃣ Knowledge-Guided Deep Fractal Neural Networks for Human Pose Estimation (2017) [Project page] [Paper]

3D Models

📷1️⃣ A simple yet effective baseline for 3d human pose estimation (2017) [Project page][Paper]

🎥1️⃣ VNect: Real-time 3D Human Pose Estimation with a Single RGB Camera (2017) [Project page][Paper]

📷🔢 Single-Shot Multi-Person 3D Body Pose Estimation From Monocular RGB Input (2018) [Paper]

📷1️⃣ Monocular 3D Human Pose Estimation In The Wild Using Improved CNN Supervision (2017) [Project page][Paper]

📷🔢 DensePose: Dense Human Pose Estimation In The Wild (2018) [Project page][Paper]

🎥1️⃣ End-to-end Recovery of Human Shape and Pose (2017) [Project page][Paper]

🎥🔢 LCR-Net++: Multi-person 2D and 3D Pose Detection in Natural Images (2018) [Project page][Paper]

🎥1️⃣ Spatio-temporal Matching for Human Pose Estimation (2014) [Project page][Paper]

🎥1️⃣ Sparseness Meets Deepness: 3D Human Pose Estimation from Monocular Video (2016) [Paper]

📷1️⃣ Learning to Fuse 2D and 3D Image Cues for Monocular Body Pose Estimation (2017) [Paper]

📷1️⃣ Keep it SMPL: Automatic Estimation of 3D Human Pose and Shape from a Single Image (2016) [Paper]

📷1️⃣ MoCap-guided Data Augmentation for 3D Pose Estimation in the Wild (2016) [Paper]

📷1️⃣ Lifting from the Deep: Convolutional 3D Pose Estimation from a Single Image (2017) [Paper]

🎥1️⃣ MonoPerfCap: Human Performance Capture from Monocular Video (2018) [Project page] [Paper]

📷1️⃣ Unsupervised Adversarial Learning of 3D Human Pose from 2D Joint Locations (2018) [Project page] [Paper]

📷1️⃣ 3D Human Pose Estimation in the Wild by Adversarial Learning (2018) [Paper]

📷🔢 Deep Human Pose Estimation Using Cascade of Multiple Neural Networks (2018) [Paper]

🎥1️⃣ Deep 3D Human Pose Estimation Under Partial Body Presence (2018) [Paper]

🎥1️⃣ 3D Ego-Pose Estimation via Imitation Learning (2018) [Paper]

📷1️⃣ Neural Body Fitting: Unifying Deep Learning and Model-Based Human Pose and Shape Estimation (2018) [Paper]