OAK For Unity

OAK For Unity is in active development. Its features and API are subject to significant change as development progresses.

Current status (change log):

2022-06-05: Body pose demo scene for WINDOWS.

2022-05-04: Fix point cloud issues when export as binary. Color point cloud.

2022-03-10: Object detector demo scene for WINDOWS.

2022-02-21: Face detector demo scene for WINDOWS.

2022-01-19: Demo menu scene added. Now it's much easier to navigate throught the demos. Go to menu on top: "OAK For Unity"->"Example scenes" and hit play

What is OAK For Unity? (Click here for more detail)

OAK For Unity is native plugin for Windows, Linux and MacOS (Android support ongoing) to enable OAK devices and capabilities inside Unity. Main goal is bring the power of OAK devices, CV and Edge AI to Unity community to build the next generation of Spatial AI / Edge AI applications.

This repository contains everything you need to integrate OAK with Unity.

• Unity projects and examples
• depthai-unity C/C++ library (source code and precompiled binaries)
• .unitypackage to easy import OAK For Unity into your project (Coming soon)
• Notice there is no C# wrapper available at this moment. We plan to do partial C# wrapper of depthai-core library in the future.

Help build the roadmap checking out our Roadmap discussion and feel free to explain about your use case.

OAK For Creators. Unity plugin and pretrained models.

Getting started

Quick Installation Instructions

Get your local workspace up and running quickly (less than 30 secs)

OAK For Unity

Everything related to OAK For Unity package, projects and demo scenes.

This repo contains precompiled versions of depthai-unity library lowering any entry barrier, so you don't need to deal with C/C++ compilation.

Prebuild Unity demos

Do you want to try some of our demos?

Do you need to update depthai-unity? Do you want to integrate your own pipeline using depthai-unity library? We got you covered on the following section.

Building depthai-unity (OPTIONAL)

Building depthai-unity library - Coming soon

Detailed instructions covering all steps to build depthai-unity C/C++ library (based on depthai-core C++ library) for all the platforms

Tutorial: Integrating your own pipeline inside Unity - Coming soon

Step-by-step tutorial how to integrate your own pipeline inside Unity. Please check how to build depthai-unity library first if you didn't.

FAQ - Coming soon

Check out our FAQ for a list of common questions, tips, tricks, and some sample code.

Documentation

In-depth documentation on individual components of the package

Community and Support

If you run into any other problems with the OAK For Unity or have a specific feature request, please submit a GitHub issue.

Example projects

• HDRP project (Coming soon)
• URP project (Coming soon)
• Integration with Unity Perception package for synthetic dataset with automatic labelling (Coming soon)
• Integration with Unity Robotics Hub package and ROS (Coming soon)

Community Projects

Are you building spatial app using OAK For Unity? Please DM and will be a pleasure to add a reference here

• jbb-kryo is building Unity app with some support for HoloLens2 and MKRT. Take a look here: https://github.com/kryotech-ltd/depthai-unity/tree/mkrt-hl2-update

Compatibility

Known issues

If you just use the precompiled depthai-unity library inside Unity, be sure you're using latest version.

Related links

• Discord
• Unity forum
• Youtube playlist

License

OAK For Unity is licensed under MIT License. See LICENSE for the full license text.