All Projects → wongfei → ue4-mediapipe-plugin

wongfei / ue4-mediapipe-plugin

Licence: Apache-2.0 license
UE4 MediaPipe plugin

Programming Languages

C++
36643 projects - #6 most used programming language
C#
18002 projects
Batchfile
5799 projects
c
50402 projects - #5 most used programming language

Projects that are alternatives of or similar to ue4-mediapipe-plugin

google-mediapipe
Google MediaPipe Face + Hands + Body + Object
Stars: ✭ 55 (-65.41%)
Mutual labels:  face-tracking, body-tracking, hand-tracking
mediapipe-osc
MediaPipe examples which stream their detections over OSC.
Stars: ✭ 26 (-83.65%)
Mutual labels:  hand-tracking, mediapipe
UnityHandTrackingWithMediapipe
Realtime hand tracking and finger tracking in Unity using Mediapipe
Stars: ✭ 129 (-18.87%)
Mutual labels:  hand-tracking, mediapipe
depthai hand tracker
Running Google Mediapipe Hand Tracking models on Luxonis DepthAI hardware (OAK-D-lite, OAK-D, OAK-1,...)
Stars: ✭ 284 (+78.62%)
Mutual labels:  hand-tracking, mediapipe
Realistic-Atmosphere-Godot-and-UE4
A realistic atmosphere material for both the Godot game engine and Unreal Engine 4
Stars: ✭ 119 (-25.16%)
Mutual labels:  unreal-engine-4
RyansUE4Helpers
Extremely helpful helper functions for developing Blueprint and C++ projects in Unreal Engine.
Stars: ✭ 55 (-65.41%)
Mutual labels:  unreal-engine-4
Streamlit-Applications
Deep Learning and Computer Vision Applications using Streamlit
Stars: ✭ 55 (-65.41%)
Mutual labels:  mediapipe
FaceAvataaars
Puppeteer Avataaars with your iPhone X (and also test cartoons using BlendShapeRecorder data)
Stars: ✭ 19 (-88.05%)
Mutual labels:  face-tracking
Kosm-Classic-FPS-Template-UE4
Classic Arena First-Person-Shooter Mechanics for Unreal Engine 4.
Stars: ✭ 38 (-76.1%)
Mutual labels:  unreal-engine-4
TwitchAuth
Unreal Engine 4 Plugin for In-Game Twitch Authentication.
Stars: ✭ 21 (-86.79%)
Mutual labels:  unreal-engine-4
BluePrintRenderer
Javascript Unreal Engine 4 Blueprints Renderer
Stars: ✭ 81 (-49.06%)
Mutual labels:  unreal-engine-4
jeelizGlanceTracker
JavaScript/WebGL lib: detect if the user is looking at the screen or not from the webcam video feed. Lightweight and robust to all lighting conditions. Great for play/pause videos if the user is looking or not, or for person detection. Link to live demo.
Stars: ✭ 68 (-57.23%)
Mutual labels:  face-tracking
Face-Detection-and-Tracking
Computer Vision model to detect face in the first frame of a video and to continue tracking it in the rest of the video. This is implemented in OpenCV 3.3.0 and Python 2.7
Stars: ✭ 24 (-84.91%)
Mutual labels:  face-tracking
ARFaceFilter
Javascript/WebGL lightweight face tracking library designed for augmented reality webcam filters. Features : multiple faces detection, rotation, mouth opening. Various integration examples are provided (Three.js, Babylon.js, FaceSwap, Canvas2D, CSS3D...).
Stars: ✭ 72 (-54.72%)
Mutual labels:  face-tracking
PCGML-Game-Mechanics
Master thesis: "Using Procedural Content Generation via Machine Learning as a Game Mechanic" with a prototype in Unreal Engine 4.22.
Stars: ✭ 43 (-72.96%)
Mutual labels:  unreal-engine-4
Vision
Computer Vision And Neural Network with Xamarin
Stars: ✭ 54 (-66.04%)
Mutual labels:  face-tracking
Handgator
✋ Navigating desktop with hand gesture
Stars: ✭ 13 (-91.82%)
Mutual labels:  hand-tracking
WebCameraFeed
Web Camera plugin for Unreal Engine
Stars: ✭ 50 (-68.55%)
Mutual labels:  unreal-engine-4
UT GameEventSystem
A flexible event system in Unreal Engine 4
Stars: ✭ 33 (-79.25%)
Mutual labels:  unreal-engine-4
Face-Mask
Real time webcam face detection, protect yourself from COVID19 with a virtual mask
Stars: ✭ 64 (-59.75%)
Mutual labels:  mediapipe

UE4 MediaPipe plugin

WARNING: this project is experimental and recommended for experienced developers only!

Platforms: UE 4.27 / 5.0 (Windows ONLY, other will not be supported)

2D features: Face, Iris, Hands, Pose, Holistic

3D features: Face Mesh, World Pose

Demo video: https://www.youtube.com/watch?v=_gRGjGn6FQE

(Optional) Building the plugin and MediaPipe wrapper library

Clone plugin

git clone https://github.com/wongfei/ue4-mediapipe-plugin.git

Clone wrapper

git clone -b unreal https://github.com/wongfei/mediapipe.git ue4-mediapipe-wrapper

Setup workspace

Build wrapper

cd ue4-mediapipe-wrapper

bazel build -c opt --define MEDIAPIPE_DISABLE_GPU=1 --action_env PYTHON_BIN_PATH="C:\\Python39\\python.exe" mediapipe/unreal:ump_shared

See: ue4-mediapipe-wrapper\mediapipe\unreal\scripts\build_shared.cmd

Copy ump_shared.dll to ue4-mediapipe-plugin\Plugins\MediaPipe\ThirdParty\mediapipe\Binaries\Win64\

See: ue4-mediapipe-wrapper\mediapipe\unreal\scripts\deploy.cmd

Other deps

Protobuf 3.11.4

Copy libprotobuf.lib to ue4-mediapipe-plugin\Plugins\MediaPipe\ThirdParty\protobuf\Lib\Win64\

(Optional) OpenCV 3.4.10 with fixed CAP_MSMF

git clone -b msmf_fix_3410 https://github.com/wongfei/opencv.git

Copy opencv_world3410.dll to ue4-mediapipe-plugin\Plugins\MediaPipe\ThirdParty\mediapipe\Binaries\Win64\

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].