All Projects → UnityLabs → barracuda-style-transfer

UnityLabs / barracuda-style-transfer

Licence: other
Companion code for the Unity Style Transfer blog post, showcasing realtime style transfer using Barracuda.

Programming Languages

C#
18002 projects

Projects that are alternatives of or similar to barracuda-style-transfer

Tf trt models
TensorFlow models accelerated with NVIDIA TensorRT
Stars: ✭ 621 (+392.86%)
Mutual labels:  realtime, inference
Opennars
OpenNARS for Research 3.0+
Stars: ✭ 264 (+109.52%)
Mutual labels:  realtime, inference
GLStyleNet
Semantic style transfer, code and data for "GLStyleNet: Exquisite Style Transfer Combining Global and Local Pyramid Features" (IET Computer Vision 2020)
Stars: ✭ 48 (-61.9%)
Mutual labels:  style-transfer
gospn
A free, open-source inference and learning library for Sum-Product Networks (SPN)
Stars: ✭ 24 (-80.95%)
Mutual labels:  inference
UnityRaymarching
raymarching experiment in unity
Stars: ✭ 73 (-42.06%)
Mutual labels:  realtime
NasdaqCloudDataService-SDK-Java
Nasdaq Data Link provides a modern and efficient method of delivery for real-time exchange data and other financial information. This repository provides a Java SDK for developing applications using Nasdaq Data Link's real-time data.
Stars: ✭ 70 (-44.44%)
Mutual labels:  realtime
MobilePose
Light-weight Single Person Pose Estimator
Stars: ✭ 588 (+366.67%)
Mutual labels:  realtime
chainer-fcis
[This project has moved to ChainerCV] Chainer Implementation of Fully Convolutional Instance-aware Semantic Segmentation
Stars: ✭ 45 (-64.29%)
Mutual labels:  inference
UPPERCASE
실시간성에 특화된 풀스택 프레임워크 ✨
Stars: ✭ 30 (-76.19%)
Mutual labels:  realtime
mix-stage
Official Repository for the paper Style Transfer for Co-Speech Gesture Animation: A Multi-Speaker Conditional-Mixture Approach published in ECCV 2020 (https://arxiv.org/abs/2007.12553)
Stars: ✭ 22 (-82.54%)
Mutual labels:  style-transfer
android tflite
GPU Accelerated TensorFlow Lite applications on Android NDK. Higher accuracy face detection, Age and gender estimation, Human pose estimation, Artistic style transfer
Stars: ✭ 105 (-16.67%)
Mutual labels:  style-transfer
Neural-Style-Transfer
Using CNN to achieve style transfer
Stars: ✭ 14 (-88.89%)
Mutual labels:  style-transfer
ims
📚 Introduction to Modern Statistics - A college-level open-source textbook with a modern approach highlighting multivariable relationships and simulation-based inference.
Stars: ✭ 509 (+303.97%)
Mutual labels:  inference
fastapi websocket pubsub
A fast and durable Pub/Sub channel over Websockets. FastAPI + WebSockets + PubSub == ⚡ 💪 ❤️
Stars: ✭ 255 (+102.38%)
Mutual labels:  realtime
mlss-2016
MLSS 2016 material.
Stars: ✭ 22 (-82.54%)
Mutual labels:  inference
intruder-detector-python
Build an application that alerts you when someone enters a restricted area. Learn how to use models for multiclass object detection.
Stars: ✭ 16 (-87.3%)
Mutual labels:  inference
Android-Tensorflow-Style-Transfer
An Android app built with an artistic style transfer neural network
Stars: ✭ 31 (-75.4%)
Mutual labels:  style-transfer
Molecules Dataset Collection
Collection of data sets of molecules for a validation of properties inference
Stars: ✭ 69 (-45.24%)
Mutual labels:  inference
IGoR
IGoR is a C++ software designed to infer V(D)J recombination related processes from sequencing data. Find full documentation at:
Stars: ✭ 42 (-66.67%)
Mutual labels:  inference
PSGAN-NCNN
PSGAN running with ncnn⚡妆容迁移/仿妆⚡Imitation Makeup/Makeup Transfer⚡
Stars: ✭ 140 (+11.11%)
Mutual labels:  style-transfer

Barracuda Style Transfer code sample.

Style transfer applyed to Book of the Dead Environement Style transfer applyed to Book of the Dead Environment via Unity Barracuda.

This repo is the companion code for the Style Transfer blog post and presents how to setup the style transfer in a sample scene.

Instructions:

  • Open BarracudaStyleTransfer/SampleScene/SampleScene.unity with Unity 2019.4.1f1 LTS (2020.x should also work)
  • Run the scene. It can take some time to start due to the loading of the network.
  • The style transfer script is found on the Style Transfer Camera object

Important:

  • Only GPU workers are supported.
  • Only desktop are supported.
  • Use Barracuda 3.0.0.

Controls:

  • Left click to enable/disable style transfer.
  • Right click to cycle through the styles.
  • Mouse wheel up/down to increase/decrease the amount of framerate upsampling (see notes below)

Style transfer script settings:

  • Style Transfer / Model to use:

    • "Reference": Costly and heavier stylization network
    • "Ref but 32 channels": Optimized, lighter stylization network
  • Framerate Upsampling: Image-space bidirectional temporal scene reprojection (http://hhoppe.com/proj/bireproj/).

    • Use Framerate Upsampling : enable or disable framerate upsampling
    • Framerate Upsample Factor : by how much to (theoretically) multiply the framerate. Also corresponds to how many frames the style transfer computation will be spread on.

Known bugs/limitations:

  • The network was trained using sRGB data, the code in this repo explicitely handles conversion from texture to sRGB tensor. Support will be added to Barracuda in a later version.
Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].