GitPlanet

Cheap and reliable Node.js hosting starts at $3/month, and $1/month static HTML hosting

Created with love in Canada, visit hostnodejs.com today

Feel like to post an Ad? Learn Details
All Projects → MarekKowalski → Livescan3d Hololens

MarekKowalski / Livescan3d Hololens

Licence: mit
A Unity application for receiving and rendering point clouds on Hololens and other devices.

Labels

unityhololens

Projects that are alternatives of or similar to Livescan3d Hololens

Mr Realtime Translator
Real-time translation services in Mixed Reality. Core pieces to get audio from the mic in Unity and stream over a websocket to the Azure Translator API and process the responses - as you speak!
Stars: ✭ 22 (-95.21%)
Mutual labels:  unity, hololens
Mixedrealitytoolkit Unity
Mixed Reality Toolkit (MRTK) provides a set of components and features to accelerate cross-platform MR app development in Unity.
Stars: ✭ 4,817 (+949.46%)
Mutual labels:  unity, hololens
Mixedreality Webrtc
MixedReality-WebRTC is a collection of components to help mixed reality app developers integrate audio and video real-time communication into their application and improve their collaborative experience
Stars: ✭ 568 (+23.75%)
Mutual labels:  unity, hololens
Holobot
HoloBot is a reusable 3D interface that allows HoloLens & VR users to interact with any bot using Mixed Reality & Speech.
Stars: ✭ 114 (-75.16%)
Mutual labels:  unity, hololens
Hololenswithopencvforunityexample
HoloLens With OpenCVforUnity Example
Stars: ✭ 142 (-69.06%)
Mutual labels:  unity, hololens
Hololens facial recognition
A Unity hololens app to detect faces and display their attributes
Stars: ✭ 217 (-52.72%)
Mutual labels:  unity, hololens
Unitychatsdk
Unity Video Chat SDK supports UnityEditor, Android,iOS,Windows,UWP(Hololens)
Stars: ✭ 105 (-77.12%)
Mutual labels:  unity, hololens
Holoviveobserver
Shared Reality: Observe a VR session from the same room using a HoloLens!
Stars: ✭ 126 (-72.55%)
Mutual labels:  unity, hololens
Dxr
DXR is a Unity package for rapid prototyping of immersive data visualizations in augmented, mixed, and virtual reality (AR, MR, VR) or XR for short.
Stars: ✭ 134 (-70.81%)
Mutual labels:  unity, hololens
Simple Webxr Unity
⭐ Bringing WebXR to Unity 3D with 3 files ! B-)
Stars: ✭ 215 (-53.16%)
Mutual labels:  unity, hololens
Hololenscamerastream
This Unity plugin makes the HoloLens video camera frames available to a Unity app in real time. This enables Unity devs to easily use the HoloLens camera for computer vision (or anything they want).
Stars: ✭ 233 (-49.24%)
Mutual labels:  unity, hololens
Awesome Unity
A curated list of awesome Unity assets, resources, and more.
Stars: ✭ 4,753 (+935.51%)
Mutual labels:  unity
Unity Texture Packer
🔨 Utility to combine color channels from different textures into a single output.
Stars: ✭ 429 (-6.54%)
Mutual labels:  unity
Virtualmotioncapture
VRゲーム中にモデルをコントロール
Stars: ✭ 423 (-7.84%)
Mutual labels:  unity
Urho
Code to integrate with the Urho3D engine
Stars: ✭ 423 (-7.84%)
Mutual labels:  hololens
Sipsorcery
A WebRTC, SIP and VoIP library for C# and .NET Core. Designed for real-time communications apps.
Stars: ✭ 449 (-2.18%)
Mutual labels:  unity
Actors.unity
🚀Actors is a framework empowering developers to make better games faster on Unity.
Stars: ✭ 437 (-4.79%)
Mutual labels:  unity
Hogwarts
Hogwarts (Harry Potter) open sandbox game made in Unity
Stars: ✭ 420 (-8.5%)
Mutual labels:  unity
Urepl
In-game powerful REPL environment for Unity3D.
Stars: ✭ 418 (-8.93%)
Mutual labels:  unity
Smaa
A highly customizable implementation of Subpixel Morphological Antialiasing for Unity
Stars: ✭ 415 (-9.59%)
Mutual labels:  unity
View All Similar Projects ➔

LiveScan3D-Hololens

This application allows for streaming point clouds to a Unity application or to a HoloLens and rendering them. Together with our other application, LiveScan3D, it can be used for viewing 3D data captured in real time (for example for telepresence) or pre-recorded data.

You will find a short presentation of the application in the video below (click to go to YouTube): YouTube link

How to get it running with LiveScan3D

First of all you will need to setup the following apps:

  • LiveScan3D - our open-source app for 3D reconstruction using Kinects.
  • Unity - the latest one that is known to work is 2018.4.14f1.
  • Visual Studio 2019 - you will need this if you want to stream to a HoloLens, if you just want to stream to a Unity app you should not need it.

Once you have all the above open LiveScanServer, connect a client and open the live view window (it is the contents of that window that are streamed to Hololens). Alternatively, you can also use the LiveScanPlayer and play pre-recorded data. Next, start the Unity application on the same machine as the server, if everything is fine it should be working. If it is not working, let me know and I will try to fix it.

If you got this far, getting it to work on Hololens should be easy, just make sure you deploy the app using XAML UWP build type instead of D3D (this is required by the touch keyboard). Once you deploy and start the app on Hololens all you need to do is input the IP number of the server and you should see the point cloud. If there are issues try rebuilding NetworkCommunication in Release mode, the resulting dll files should be automatically copied to /Assets/Plugins/x86/

How to control the scene

The scene can be moved, scaled and rotated around the Y axis, the modes are chosen using the following voice commands:

  • Move - the scene can be moved using the tap and hold gesture.
  • Rotate - the scene can be rotated by using the tap and hold gesture and moving the hand horizontally.
  • Zoom - the scene can be scaled using the tap and hold gesture and moving the hand horizontally.
  • Reset - resets the scene to its original position, rotation and scale.

Citations

If you use this software in your research, then please use the following citation:

Kowalski, M.; Naruniec, J.; Daniluk, M.: "LiveScan3D: A Fast and Inexpensive 3D Data Acquisition System for Multiple Kinect v2 Sensors". in 3D Vision (3DV), 2015 International Conference on, Lyon, France, 2015

Authors

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].