waifu2x-ncnn-vulkan-macos

As its long long name suggested.

Acknowledgement

• waifu2x-ncnn-vulkan
• ncnn
• Vulkan SDK

Thanks

Thanks to @shincurry for contributing to the UI of this project.

Usage

Single Mode

1. Click Single on the top tab
2. Drag and drop the image you intentded to upscale to the left image cell
3. Adjust the settings at the bottom
4. Click 2x! and the generated image will be shown at the right image cell
5. Drag the image from the right image cell to where you want to save it (the filename will be waifu2x-output.png)

Multiple Mode

1. Click Multiple on the top tab
2. Drag and drop images or directories to the table. (Only decodable images will be processed)
3. Adjust the settings at the bottom
4. Click 2x! and the generated images will be saved at where them from with an extra .png extension. For example,

Input

.
├── 1
│   ├── IMG_2185.JPG
│   ├── IMG_2211.JPG
│   └── IMG_2212.JPG
├── 2
│   └── IMG_2208.PNG
└── IMG_2213.JPG

Output

.
.
├── 1
│   ├── IMG_2185.JPG
│   ├── IMG_2185.JPG.png
│   ├── IMG_2211.JPG
│   ├── IMG_2211.JPG.png
│   ├── IMG_2212.JPG
│   └── IMG_2212.JPG.png
├── 2
│   ├── IMG_2208.PNG
│   └── IMG_2208.PNG.png
├── IMG_2213.JPG
└── IMG_2213.JPG.png

Benchmark

To run benchmark, please click waifu2x-gui -> Benchmark

Build Instructions

Download lastest Vulkan SDK at https://vulkan.lunarg.com/sdk/home.

At the time of this README.md wrote, 1.2.131.2 was the newest version for macOS.

brew install protobuf

# clone this repo first
git clone --depth=1 https://github.com/BlueCocoa/waifu2x-ncnn-vulkan-macos

# download lastest Vulkan SDK
export VULKAN_SDK_VER="1.2.131.2"
wget https://sdk.lunarg.com/sdk/download/${VULKAN_SDK_VER}/mac/vulkansdk-macos-${VULKAN_SDK_VER}.tar.gz?Human=true -O vulkansdk-macos-${VULKAN_SDK_VER}.tar.gz
tar xf vulkansdk-macos-${VULKAN_SDK_VER}.tar.gz
rm -rf waifu2x-ncnn-vulkan-macos/waifu2x/VulkanSDK
mv vulkansdk-macos-${VULKAN_SDK_VER} waifu2x-ncnn-vulkan-macos/waifu2x/VulkanSDK

# clone Tencent/ncnn
git clone --depth=1 https://github.com/Tencent/ncnn ncnn

# clone nihui/waifu2x-ncnn-vulkan
# (At the time of writing) https://github.com/nihui/waifu2x-ncnn-vulkan/tree/4b626f8d4a1f8ce331aa4678d93d3628d9670361
rm -rf waifu2x-ncnn-vulkan-macos/waifu2x/waifu2x-ncnn-vulkan
git clone --depth=1 https://github.com/nihui/waifu2x-ncnn-vulkan waifu2x-ncnn-vulkan-macos/waifu2x/waifu2x-ncnn-vulkan

# check your cmake installation
which cmake
# if it goes with /Applications/CMake.app/Contents/bin/cmake
# then you need to install it in /usr/local/bin via follow command
sudo "/Applications/CMake.app/Contents/bin/cmake-gui" --install

# build ncnn
rm -rf ncnn/build && mkdir -p ncnn/build && pushd ncnn/build
cmake -DNCNN_VULKAN=ON -D CMAKE_BUILD_TYPE=Release ..
make -j`sysctl -n hw.ncpu` && make install
cp -rf install/* ../../waifu2x-ncnn-vulkan-macos/waifu2x/ncnn

# compile waifu2x-ncnn-vulkan-macos
# and the compiled application will be placed at `build/Release/waifu2x-gui.app`
cd waifu2x-ncnn-vulkan-macos
xcodebuild

Notice

After the first compilation, if you want to modify this project only, you may set those flags in Build Phases -> Run Script to false to avoid recompile ncnn and regenerate shader.

Speed Comparison between Macs

Environment 1

• MacBook Pro 15-inch 2018
• macOS 10.14.6 (18G103)
• Intel Core i9 8950HK
• AMD Radeon Pro Vega 20

noise: 2, scale: 2, gpuid: 0, tta mode: NO

Environment 2

• MacBook Pro 15-inch 2018
• macOS 10.14.6 (18G84)
• Intel Core i9 8850HK
• AMD Radeon 560X

noise: 2, scale: 2, gpuid: 0, tta mode: NO

Environment 3

• MacBook Pro 15-inch 2018
• macOS 10.14.6 (18G103)
• Intel Core i9 8950HK
• Intel UHD Graphics 630

noise: 2, scale: 2, gpuid: 1, tta mode: NO

Environment 4

• MacBook 12-inch Early 2016
• macOS 10.14.6 (18G84)
• Intel Core m7 6Y75
• Intel HD Graphics 515

noise: 2, scale: 2, gpuid: 0, tta mode: NO

Speed Comparison (not really) with waifu2x-caffe-cui & waifu2x-ncnn-vulkan

Environment (waifu2x-caffe-cui & waifu2x-ncnn-vulkan)

• Windows 10 1809
• AMD R7-1700
• Nvidia GTX-1070
• Nvidia driver 419.67
• CUDA 10.1.105
• cuDNN 10.1

Environment (waifu2x-ncnn-vulkan-macos)

• macOS 10.14.6 (18G103)
• Intel Core i9 8950HK
• AMD Radeon Pro Vega 20

cunet

upconv_7_anime_style_art_rgb