All Projects → bertjiazheng → Structured3d

bertjiazheng / Structured3d

Licence: mit
[ECCV'20] Structured3D: A Large Photo-realistic Dataset for Structured 3D Modeling

Programming Languages

python
139335 projects - #7 most used programming language

Projects that are alternatives of or similar to Structured3d

instant-ngp
Instant neural graphics primitives: lightning fast NeRF and more
Stars: ✭ 1,863 (+731.7%)
Mutual labels:  computer-graphics, 3d-reconstruction
Scannet
Stars: ✭ 860 (+283.93%)
Mutual labels:  computer-graphics, 3d-reconstruction
Flame Fitting
Example code for the FLAME 3D head model. The code demonstrates how to sample 3D heads from the model, fit the model to 3D keypoints and 3D scans.
Stars: ✭ 269 (+20.09%)
Mutual labels:  computer-graphics, 3d-reconstruction
platonicgan
Escaping Plato’s Cave: 3D Shape from Adversarial Rendering [ICCV 2019]
Stars: ✭ 40 (-82.14%)
Mutual labels:  computer-graphics, 3d-reconstruction
Cnncomplete
[CVPR'17] Shape Completion using 3D-Encoder-Predictor CNNs and Shape Synthesis
Stars: ✭ 117 (-47.77%)
Mutual labels:  computer-graphics, 3d-reconstruction
StrayVisualizer
Visualize Data From Stray Scanner https://keke.dev/blog/2021/03/10/Stray-Scanner.html
Stars: ✭ 30 (-86.61%)
Mutual labels:  dataset, 3d-reconstruction
Scancomplete
[CVPR'18] ScanComplete: Large-Scale Scene Completion and Semantic Segmentation for 3D Scans
Stars: ✭ 213 (-4.91%)
Mutual labels:  computer-graphics, 3d-reconstruction
ICON
ICON: Implicit Clothed humans Obtained from Normals (CVPR 2022)
Stars: ✭ 641 (+186.16%)
Mutual labels:  computer-graphics, 3d-reconstruction
Sgnn
[CVPR'20] SG-NN: Sparse Generative Neural Networks for Self-Supervised Scene Completion of RGB-D Scans
Stars: ✭ 112 (-50%)
Mutual labels:  computer-graphics, 3d-reconstruction
Objectron
Objectron is a dataset of short, object-centric video clips. In addition, the videos also contain AR session metadata including camera poses, sparse point-clouds and planes. In each video, the camera moves around and above the object and captures it from different views. Each object is annotated with a 3D bounding box. The 3D bounding box describes the object’s position, orientation, and dimensions. The dataset contains about 15K annotated video clips and 4M annotated images in the following categories: bikes, books, bottles, cameras, cereal boxes, chairs, cups, laptops, and shoes
Stars: ✭ 1,352 (+503.57%)
Mutual labels:  dataset, 3d-reconstruction
PointCloudRegistrationTool
Automatically registers (aligns) and visualizes point clouds, or processes a whole bunch at once
Stars: ✭ 82 (-63.39%)
Mutual labels:  computer-graphics, 3d-reconstruction
Tf flame
Tensorflow framework for the FLAME 3D head model. The code demonstrates how to sample 3D heads from the model, fit the model to 2D or 3D keypoints, and how to generate textured head meshes from Images.
Stars: ✭ 193 (-13.84%)
Mutual labels:  computer-graphics, 3d-reconstruction
Softras
Project page of paper "Soft Rasterizer: A Differentiable Renderer for Image-based 3D Reasoning"
Stars: ✭ 715 (+219.2%)
Mutual labels:  computer-graphics, 3d-reconstruction
Pifu
This repository contains the code for the paper "PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitization"
Stars: ✭ 1,021 (+355.8%)
Mutual labels:  computer-graphics, 3d-reconstruction
Flame pytorch
This is a implementation of the 3D FLAME model in PyTorch
Stars: ✭ 153 (-31.7%)
Mutual labels:  computer-graphics, 3d-reconstruction
Computervisiondatasets
Stars: ✭ 207 (-7.59%)
Mutual labels:  dataset, 3d-reconstruction
Dialogrpt
EMNLP 2020: "Dialogue Response Ranking Training with Large-Scale Human Feedback Data"
Stars: ✭ 216 (-3.57%)
Mutual labels:  dataset
H36m Fetch
Human 3.6M 3D human pose dataset fetcher
Stars: ✭ 220 (-1.79%)
Mutual labels:  dataset
Short Jokes Dataset
Python scripts for building 'Short Jokes' dataset, featured on Kaggle
Stars: ✭ 215 (-4.02%)
Mutual labels:  dataset
Ipc
Incremental Potential Contact (IPC) is for robust and accurate time stepping of nonlinear elastodynamics. IPC guarantees intersection- and inversion-free trajectories regardless of materials, time-step sizes, velocities, or deformation severity.
Stars: ✭ 215 (-4.02%)
Mutual labels:  computer-graphics

Structured3D

Structured3D

Structured3D is a large-scale photo-realistic dataset containing 3.5K house designs (a) created by professional designers with a variety of ground truth 3D structure annotations (b) and generate photo-realistic 2D images (c).

Paper

Structured3D: A Large Photo-realistic Dataset for Structured 3D Modeling

Jia Zheng*, Junfei Zhang*, Jing Li, Rui Tang, Shenghua Gao, Zihan Zhou

European Conference on Computer Vision (ECCV), 2020

[Preprint] [Paper] [Supplementary Material] [Benchmark]

(* Equal contribution)

Data

The dataset consists of rendering images and corresponding ground truth annotations (e.g., semantic, albedo, depth, surface normal, layout) under different lighting and furniture configurations. Please refer to data organization for more details.

To download the dataset, please fill the agreement form that indicates you agree to the Structured3D Terms of Use. After we receive your agreement form, we will provide download access to the dataset.

For fair comparison, we define standard training, validation, and testing splits as follows: scene_00000 to scene_02999 for training, scene_03000 to scene_03249 for validation, and scene_03250 to scene_03499 for testing.

Errata

  • 2020-04-06: We provide a list of invalid cases here. You can ignore these cases when using our data.
  • 2020-03-26: Fix issue #10 about the basis of the bounding box annotations. Please re-download the annotations if you use them.

Tools

We provide the basic code for viewing the structure annotations of our dataset.

Installation

Clone repository:

git clone [email protected]:bertjiazheng/Structured3D.git

Please use Python 3, then follow installation to install PyMesh (only for plane visualization) and the other dependencies:

conda install -y open3d -c open3d-admin
conda install -y opencv -c conda-forge
conda install -y descartes matplotlib numpy shapely
pip install panda3d

Visualize 3D Annotation

We use open3D for wireframe and plane visualization, please refer to interaction control here.

python visualize_3d.py --path /path/to/dataset --scene scene_id --type wireframe/plane/floorplan
Wireframe Plane Floorplan
Wireframe plane floorplan

Visualize 3D Textured Mesh

python visualize_mesh.py --path /path/to/dataset --scene scene_id --room room_id

Visualize 2D Layout

python visualize_layout.py --path /path/to/dataset --scene scene_id --type perspective/panorama

Panorama Layout

Please refer to the Supplementary Material for more example ground truth room layouts.

Perspective Layout

Visualize 3D Bounding Box

python visualize_bbox.py --path /path/to/dataset --scene scene_id

Citation

Please cite Structured3D in your publications if it helps your research:

@inproceedings{Structured3D,
  title     = {Structured3D: A Large Photo-realistic Dataset for Structured 3D Modeling},
  author    = {Jia Zheng and Junfei Zhang and Jing Li and Rui Tang and Shenghua Gao and Zihan Zhou},
  booktitle = {Proceedings of The European Conference on Computer Vision (ECCV)},
  year      = {2020}
}

License

The data is released under the Structured3D Terms of Use, and the code is released under the MIT license.

Contact

Please contact us at Structured3D Group if you have any questions.

Acknowledgement

We would like to thank Kujiale.com for providing the database of house designs and the rendering engine. We especially thank Qing Ye and Qi Wu from Kujiale.com for the help on the data rendering.

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].