qian256 / Hololensarucounity
Marker tracking on HoloLens built on Aruco, OpenCV and Unity
Stars: ✭ 39
Projects that are alternatives of or similar to Hololensarucounity
Mrlightingtools Unity
A Unity library and MRTK extension for estimating and replicating the current environment's lighting on Mixed Reality devices.
Stars: ✭ 142 (+264.1%)
Mutual labels: unity3d, hololens
Hololenswithopencvforunityexample
HoloLens With OpenCVforUnity Example
Stars: ✭ 142 (+264.1%)
Mutual labels: hololens, opencv
Spatial Computing
Samples showing how to use Azure and AI services in Mixed Reality projects
Stars: ✭ 63 (+61.54%)
Mutual labels: unity3d, hololens
Hololenscamerastream
This Unity plugin makes the HoloLens video camera frames available to a Unity app in real time. This enables Unity devs to easily use the HoloLens camera for computer vision (or anything they want).
Stars: ✭ 233 (+497.44%)
Mutual labels: unity3d, hololens
Hololensartoolkit
Marker tracking using the front-facing camera of HoloLens (both 1 and 2) and Unity, with a wrapper of ARToolKit built for UWP (Windows Universal Platform)
Stars: ✭ 238 (+510.26%)
Mutual labels: unity3d, hololens
Opencvforunity
OpenCV for Unity (Untiy Asset Plugin)
Stars: ✭ 359 (+820.51%)
Mutual labels: unity3d, opencv
Mixedreality Webrtc
MixedReality-WebRTC is a collection of components to help mixed reality app developers integrate audio and video real-time communication into their application and improve their collaborative experience
Stars: ✭ 568 (+1356.41%)
Mutual labels: unity3d, hololens
Face Mask Detection
Face masks are crucial in minimizing the propagation of Covid-19, and are highly recommended or even obligatory in many situations. In this project, we develop a pipeline to detect unmasked faces in images. This can, for example, be used to alert people that do not wear a mask when entering a building.
Stars: ✭ 37 (-5.13%)
Mutual labels: opencv
Fast face detector
A face detector based on the work "Aggregate channel features for multi-view face detection" presented by Bin Yang, Junjie Yan, Zhen Lei and Stan Z. Li.
Stars: ✭ 35 (-10.26%)
Mutual labels: opencv
Traffic Light Detector
Detect traffic lights and classify the state of them, then give the commands "go" or "stop".
Stars: ✭ 37 (-5.13%)
Mutual labels: opencv
Imshow Java Opencv
an alternative to imshow() in C++ OpenCV for Java OpenCV
Stars: ✭ 34 (-12.82%)
Mutual labels: opencv
Minimumaudioplugin
Minimum implementation of a native audio plugin for Unity
Stars: ✭ 33 (-15.38%)
Mutual labels: unity3d
Unitypluginwithwsl
Unity native plugin with WSL (Windows Subsystem for Linux)
Stars: ✭ 39 (+0%)
Mutual labels: unity3d
Ipcamera Cpython Interface
兼容主流海康和雄迈IPC的适用于C++和python的帧数据获取接口
Stars: ✭ 38 (-2.56%)
Mutual labels: opencv
Opencv Tutorials
Tutorials for learning OpenCV in Python from Scratch
Stars: ✭ 36 (-7.69%)
Mutual labels: opencv
HoloLens with Aruco
Author: Long Qian
Date: 2016-06-10
Preface
2017-01-21: If you are interested in tracking fiducial markers for HoloLens, it is recommended to visit another repository of mine: HoloLensARToolKit, which has better performance than Aruco on UWP platforms.
Shortcut
- The application file
hololens_aruco_unity/HoloLensAruco_1.0.0.0_x86_Master.appxcan be deployed to HoloLens via HoloLens Device Portal.
Installation Guide
CMake for Windows 10
- Recent CMake release supports UWP already.
- If you are using CMake version earlier than 3.4, please follow this to build CMake tool with support for Windows 10.
OpenCV for UWP
- Follow this to build OpenCV binaries for Windows UWP. The "Long way" is recommended.
-
opencv_uwpfolder contains the opencv binary I built for Windows UWP (x86 only, since HoloLens run on x86). - Set environment
OpenCV_DIRto the your folder ofopencv_uwp.
Aruco Wrapper
Aruco is an open source marker tracking application based on OpenCV. aruco_core/aruco_core.cpp is a modification of aruco_simple example.
- Use the CMake tool for UWP to build the VS solution for the wrapper, navigate to the build folder, and execute:
Path\To\CMake\bin\Release\cmake.exe -G "Visual Studio 14 2015" -DCMAKE_SYSTEM_NAME:String=WindowsStore -DCMAKE_SYSTEM_VERSION:String="10.0" -DCMAKE_VS_EFFECTIVE_PLATFORMS:String=x86 .. - Open the VS solution and configure the project so that "/ZW" option is activated (Consume Windows Runtime Extension).
- Build the dll.
Unity3D for HoloLens
- Put the
aruco_core.dlland necessary OpenCV dlls to thehololens_aruco_unity/Assets/Plugins/WSA/x86/folder. - Choose the
arucoSideBySidescene from theAssets/Scenesfolder - Export to HoleLens and run! (You need to print an Aruco marker to see the effect.)
Issues
- The pose of Aruco marker is augmented through 2D processed image, not in terms of 3D overlay. However, 3D overlay is not hard to achieve by combining the marker tracking of Aruco and the environmental tracking of HoloLens.
- Frame rate is lowered since C# is transfering raw image data to aruco_core.dll. This could be improved by compressing the image on both sides (Unity script and aruco_core). This issue is addressed by HoloLensARToolKit
Note that the project description data, including the texts, logos, images, and/or trademarks,
for each open source project belongs to its rightful owner.
If you wish to add or remove any projects, please contact us at [email protected].