All Projects → leilimaster → DmifNet

leilimaster / DmifNet

Licence: MIT license
This repository contains the source codes for the paper "DmifNet: 3D Shape Reconstruction based on Dynamic Multi–Branch Information Fusion (ICPR 2020 Oral)"

Programming Languages

python
139335 projects - #7 most used programming language
C++
36643 projects - #6 most used programming language
Cuda
1817 projects
c
50402 projects - #5 most used programming language
Mako
254 projects

Projects that are alternatives of or similar to DmifNet

SSVIO
Graduation Project: A point cloud semantic segmentation and VIO based 3D reconstruction method using RGB-D and IMU
Stars: ✭ 25 (+25%)
Mutual labels:  3d-reconstruction
PointCloudRegistrationTool
Automatically registers (aligns) and visualizes point clouds, or processes a whole bunch at once
Stars: ✭ 82 (+310%)
Mutual labels:  3d-reconstruction
shape as points
[NeurIPS'21] Shape As Points: A Differentiable Poisson Solver
Stars: ✭ 398 (+1890%)
Mutual labels:  3d-reconstruction
Portrait FCN and 3D Reconstruction
This project is to convert PortraitFCN+ (by Xiaoyong Shen) from Matlab to Tensorflow, then refine the outputs from it (converted to a trimap) using KNN and ResNet, supervised by Richard Berwick.
Stars: ✭ 61 (+205%)
Mutual labels:  3d-reconstruction
simple-sfm
A readable implementation of structure-from-motion
Stars: ✭ 19 (-5%)
Mutual labels:  3d-reconstruction
neurecon
Multi-view 3D reconstruction using neural rendering. Unofficial implementation of UNISURF, VolSDF, NeuS and more.
Stars: ✭ 697 (+3385%)
Mutual labels:  3d-reconstruction
maks
Motion Averaging
Stars: ✭ 52 (+160%)
Mutual labels:  3d-reconstruction
Point2Mesh
Meshing Point Clouds with Predicted Intrinsic-Extrinsic Ratio Guidance (ECCV2020)
Stars: ✭ 61 (+205%)
Mutual labels:  3d-reconstruction
relative pose
A Collection of Algorithms for Relative Pose Estimation of a Calibrated Camera
Stars: ✭ 27 (+35%)
Mutual labels:  3d-reconstruction
NeuralPull
Implementation of ICML'2021:Neural-Pull: Learning Signed Distance Functions from Point Clouds by Learning to Pull Space onto Surfaces
Stars: ✭ 149 (+645%)
Mutual labels:  3d-reconstruction
r3live
A Robust, Real-time, RGB-colored, LiDAR-Inertial-Visual tightly-coupled state Estimation and mapping package
Stars: ✭ 1,355 (+6675%)
Mutual labels:  3d-reconstruction
DSP-SLAM
[3DV 2021] DSP-SLAM: Object Oriented SLAM with Deep Shape Priors
Stars: ✭ 377 (+1785%)
Mutual labels:  3d-reconstruction
mvsnerf
[ICCV 2021] Our work presents a novel neural rendering approach that can efficiently reconstruct geometric and neural radiance fields for view synthesis.
Stars: ✭ 533 (+2565%)
Mutual labels:  3d-reconstruction
global l0
Global L0 algorithm for regularity-constrained plane fitting
Stars: ✭ 45 (+125%)
Mutual labels:  3d-reconstruction
void-dataset
Visual Odometry with Inertial and Depth (VOID) dataset
Stars: ✭ 74 (+270%)
Mutual labels:  3d-reconstruction
aistplusplus api
API to support AIST++ Dataset: https://google.github.io/aistplusplus_dataset
Stars: ✭ 277 (+1285%)
Mutual labels:  3d-reconstruction
3D-Public-Transport-Simulator
The 3D Public Transport Simulator is a Unity-based simulation, which uses OpenStreetMap data in order to support the simulation of worldwide locations. The development was part of a Bachelor thesis.
Stars: ✭ 87 (+335%)
Mutual labels:  3d-reconstruction
platonicgan
Escaping Plato’s Cave: 3D Shape from Adversarial Rendering [ICCV 2019]
Stars: ✭ 40 (+100%)
Mutual labels:  3d-reconstruction
PSVH-3d-reconstruction
Deep Single-View 3D Object Reconstruction with Visual Hull Embedding
Stars: ✭ 38 (+90%)
Mutual labels:  3d-reconstruction
obman
[cvpr19] Hands+Objects synthetic dataset, instructions to download and code to load the dataset
Stars: ✭ 120 (+500%)
Mutual labels:  3d-reconstruction

DmifNet

Example 1 Example 2 Example 3 Example 4

Citing this work

If you find our code or paper useful, please consider citing

@inproceedings{li2021dmifnet,
  title={DmifNet: 3D Shape Reconstruction based on Dynamic Multi-Branch Information Fusion},
  author={Li, Lei and Wu, Suping},
  booktitle={2020 25th International Conference on Pattern Recognition (ICPR)},
  pages={7219--7225},
  year={2021},
  organization={IEEE}
}

Configuration Environment

Python3.6, Pytorch: 1.0, CUDA: 9.0+, Cudnn: follow Cuda version, GPU: one Nvidia RTX 2080Ti
Epoch: Approximately close to the optimal convergence value between 1500 and 2500 epoch

Installation

First you have to make sure that you have all dependencies in place.

You can create an anaconda environment called dmifnet_space using

conda env create -f dmif_env.yaml
conda activate dmifnet_space

Then, compile the extension modules.

python set_env_up.py build_ext --inplace

Then, download the BatchNet modules.

Next, put your model path in DmifNet/dmifnet/encoder/batchnet.py /def resnet18(pretrained=False, **kwargs):

Generation

To generate meshes using a trained model, use

python generate.py ./config/img/dmifnet.yaml

Training

python train.py ./config/img/dmifnet.yaml

DataSet

You can check the baseline work Onet to download the datasetONet and DmifNet: DataSet. Thanks for contribution of baseline work.

Evaluation

First, to generate meshes using a trained model, use

python generate.py ./config/img/dmifnet.yaml

Then, for evaluation of the models, you can run it using

python eval_meshes.py ./config/img/dmifnet.yaml

also can use quick evaluation(don't need generation).

python eval.py ./config/img/dmifnet.yaml

Pretrained model

you can download our pretrained model via Baidu Netdisk or Google Drive

  • download the DmifNet via BaiDu and Extracted key is 3hfs
  • download the DmifNet via Google

Quantitative Results

Method Intersection over Union Normal consistency Chamfer distance
3D-R2N2 0.493 0.695 0.278
Pix2Mesh 0.480 0.772 0.216
AtlasNet -- 0.811 0.175
ONet 0.571 0.834 0.215
DmifNet 0.607 0.846 0.185

Qualitative Results

Futher Information

If you have any problems with the code, please list the problems you encountered in the issue area, and I will reply you soon. Thanks for baseline work Occupancy Networks - Learning 3D Reconstruction in Function Space.

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].