Subdivision-based Mesh Convolutional Networks
The implementation of SubdivNet in our paper, Subdivion-based Mesh Convolutional Networks
News
🔥 This paper was accepted by ACM TOG.
Features
- Provides implementations of mesh classification and segmentation on various datasets.
- Provides ready-to-use datasets, pretrained models, training and evaluation scripts.
- Supports a batch of meshes with different number of faces.
Requirements
- python3.7+
- CUDA 10.1+
- Jittor
To install other python requirements:
pip install -r requirements.txt
Fetch Data
This repo provides training scripts for classification and segementation, on the following datasets,
- shrec11-split10
- shrec11-split16
- cubes
- manifold40 (based on ModelNet40)
- humanbody
- coseg-aliens
- coseg-vases
To download the preprocessed data, run
sh scripts/<DATASET_NAME>/get_data.sh
The
Manfold40dataset (before remeshed, without subdivision connectivity) can be downloaded via this link. Note that this version cannot be used as inputs of SubdivNet. To train SubdivNet, run scripts/manifold40/get_data.sh.
Training
To train the model(s) in the paper, run this command:
sh scripts/<DATASET_NAME>/train.sh
To speed up training, you can use multiple gpus. First install OpenMPI:
sudo apt install openmpi-bin openmpi-common libopenmpi-dev
Then run the following command,
CUDA_VISIBLE_DEVICES="2,3" mpirun -np 2 sh scripts/<DATASET_NAME>/train.sh
Evaluation
To evaluate the model on a dataset, run:
sh scripts/<DATASET_NAME>/test.sh
The pretrained weights are provided. Run the following command to download them.
sh scripts/<DATASET_NAME>/get_pretrained.sh
Visualize
After testing the segmentation network, there will be colored shapes in a results directory.
How to apply SubdivNet to your own data
SubdivNet cannot be directly applied to any common meshes, because it requires the input to hold the subdivision connectivity.
To create your own data with subdivision connectivity, you may use the provided tool that implements the MAPS algorithm. You may also refer to NeuralSubdivision, as they provide a MATLAB script for remeshing.
To run our implemented MAPS algorithm, first install the following python dependecies,
triangle
pymeshlab
shapely
sortedcollections
networkx
rtree
Then see datagen_maps.py and modify the configurations to remesh your 3D shapes for subdivision connectivity.
Cite
Please cite our paper if you use this code in your own work:
@article{DBLP:journals/tog/HuLGCHMM22,
author = {Shi{-}Min Hu and
Zheng{-}Ning Liu and
Meng{-}Hao Guo and
Junxiong Cai and
Jiahui Huang and
Tai{-}Jiang Mu and
Ralph R. Martin},
title = {Subdivision-based Mesh Convolution Networks},
journal = {{ACM} Trans. Graph.},
volume = {41},
number = {3},
pages = {25:1--25:16},
year = {2022},
url = {https://doi.org/10.1145/3506694},
doi = {10.1145/3506694}
}