All Projects → XinArkh → Vnect

XinArkh / Vnect

Licence: apache-2.0
Real-time 3D human pose estimation, implemented by tensorflow

Programming Languages

python
139335 projects - #7 most used programming language

Projects that are alternatives of or similar to Vnect

Poseestimationformobile
💃 Real-time single person pose estimation for Android and iOS.
Stars: ✭ 783 (+398.73%)
Mutual labels:  human-pose-estimation
Personlab Tf
implementation of PersonLab(https://arxiv.org/abs/1803.08225) using TF-slim
Stars: ✭ 103 (-34.39%)
Mutual labels:  human-pose-estimation
Cdcl Human Part Segmentation
Repository for Paper: Cross-Domain Complementary Learning Using Pose for Multi-Person Part Segmentation (TCSVT20)
Stars: ✭ 143 (-8.92%)
Mutual labels:  human-pose-estimation
Pytorch Pose
A PyTorch toolkit for 2D Human Pose Estimation.
Stars: ✭ 932 (+493.63%)
Mutual labels:  human-pose-estimation
Shelfnet Human Pose Estimation
Fast and accurate Human Pose Estimation using ShelfNet with PyTorch
Stars: ✭ 95 (-39.49%)
Mutual labels:  human-pose-estimation
Human Pose Estimation Papers
2D&3D human pose estimation
Stars: ✭ 126 (-19.75%)
Mutual labels:  human-pose-estimation
Keras realtime multi Person pose estimation
Keras version of Realtime Multi-Person Pose Estimation project
Stars: ✭ 728 (+363.69%)
Mutual labels:  human-pose-estimation
Evoskeleton
Official project website for the CVPR 2020 paper (Oral Presentation) "Cascaded Deep Monocular 3D Human Pose Estimation With Evolutionary Training Data"
Stars: ✭ 154 (-1.91%)
Mutual labels:  human-pose-estimation
Human Pose Estimation
This repository implements a demo of the Human pose estimation via Convolutional Part Heatmap Regression paper.
Stars: ✭ 98 (-37.58%)
Mutual labels:  human-pose-estimation
Vibe
Official implementation of CVPR2020 paper "VIBE: Video Inference for Human Body Pose and Shape Estimation"
Stars: ✭ 2,080 (+1224.84%)
Mutual labels:  human-pose-estimation
Lightweight Human Pose Estimation.pytorch
Fast and accurate human pose estimation in PyTorch. Contains implementation of "Real-time 2D Multi-Person Pose Estimation on CPU: Lightweight OpenPose" paper.
Stars: ✭ 958 (+510.19%)
Mutual labels:  human-pose-estimation
Pose Adv Aug
Code for "Jointly Optimize Data Augmentation and Network Training: Adversarial Data Augmentation in Human Pose Estimation" (CVPR 2018)
Stars: ✭ 83 (-47.13%)
Mutual labels:  human-pose-estimation
Tensorflow realtime multi Person pose estimation
Multi-Person Pose Estimation project for Tensorflow 2.0 with a small and fast model based on MobilenetV3
Stars: ✭ 129 (-17.83%)
Mutual labels:  human-pose-estimation
Awesome Human Pose Estimation
Human Pose Estimation Related Publication
Stars: ✭ 828 (+427.39%)
Mutual labels:  human-pose-estimation
Awesome Human Pose Estimation
A collection of awesome resources in Human Pose estimation.
Stars: ✭ 2,022 (+1187.9%)
Mutual labels:  human-pose-estimation
Convolutional Pose Machines Tensorflow
Stars: ✭ 758 (+382.8%)
Mutual labels:  human-pose-estimation
Metrabs
This is a computer vision algorithm that takes a single RGB image as the input and estimates 3D human poses as the output.
Stars: ✭ 123 (-21.66%)
Mutual labels:  human-pose-estimation
V2v Posenet Pytorch
PyTorch implementation of V2V-PoseNet with IntegralPose/PoseFix loss
Stars: ✭ 156 (-0.64%)
Mutual labels:  human-pose-estimation
Pytorch Pose Estimation
PyTorch Implementation of Realtime Multi-Person Pose Estimation project.
Stars: ✭ 152 (-3.18%)
Mutual labels:  human-pose-estimation
Gccpm Look Into Person Cvpr19.pytorch
Fast and accurate single-person pose estimation, ranked 10th at CVPR'19 LIP challenge. Contains implementation of "Global Context for Convolutional Pose Machines" paper.
Stars: ✭ 137 (-12.74%)
Mutual labels:  human-pose-estimation

VNect

A tensorflow implementation of VNect: Real-time 3D Human Pose Estimation with a Single RGB Camera.

For the caffe model/weights required in the repository: please contact the author of the paper.

Environments

  • Python 3.x
  • tensorflow-gpu 1.x
  • pycaffe

Setup

Fedora 29

Install python dependencies:

pip3 install -r requirements.txt --user

Install caffe dependencies

sudo dnf install protobuf-devel leveldb-devel snappy-devel opencv-devel boost-devel hdf5-devel glog-devel gflags-devel lmdb-devel atlas-devel python-lxml boost-python3-devel

Setup Caffe

git clone https://github.com/BVLC/caffe.git
cd caffe

Configure Makefile.config (Include python3 and fix path)

Build Caffe

sudo make all
sudo make runtest
sudo make pycaffe
sudo make distribute
sudo cp .build_release/lib/ /usr/lib64
sudo cp -a distribute/python/caffe/ /usr/lib/python3.7/site-packages/

Usage

Preparation

  1. Drop the pretrained caffe model into models/caffe_model.
  2. Run init_weights.py to generate tensorflow model.

Application

  1. run_estimator.py is a script for video stream.
  2. (Recommended) run_estimator_ps.py is a multiprocessing version script. When 3d plotting function shuts down in run_estimator.py mentioned above, you can try this one.
  3. run_pic.py is a script for picture.
  4. (Deprecated) benchmark.py is a class implementation containing all the elements needed to run the model.
  5. (Deprecated) run_estimator_robot.py additionally provides ROS network and/or serial connection for communication in robot controlling.
  6. (Deprecated) The training script train.py is not complete yet (I failed to reconstruct the model: ( So do not use it. Also pulling requests are welcomed.

[Tips] To run the scripts for video stream:

  1. click left mouse button to initialize the bounding box implemented by a simple HOG method;

  2. trigger any keyboard input to exit while running.

Notes

  1. With some certain programming environments, the 3d plotting function (from matplotlib) in run_estimator.py shuts down. Use run_estimator_ps.py instead.
  2. The input image is in BGR color format and the pixel value is mapped into a range of [-0.4, 0.6).
  3. The joint-parent map (detailed information in materials/joint_index.xlsx):

  1. Here I have a sketch to show the joint positions (don't laugh lol):

  1. Every input image is assumed to contain 21 joints to be found, which means it is easy to fit wrong results when a joint is actually not in the picture.

About Training Data

For MPI-INF-3DHP dataset, refer to my another repository.

Reference Repositories

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].