Data-driven Structural Priors for Shape Completion
Minhyuk Sung, Vladimir G. Kim, Roland Angst, Leonidas Guibas
SIGGRAPH Asia 2015
Abstract
Acquiring 3D geometry of an object is a tedious and time-consuming task, typically requiring scanning the surface from multiple viewpoints. In this work we focus on reconstructing complete geometry from a single scan acquired with a low-quality consumer-level scanning device. Our method uses a collection of example 3D shapes to build structural part-based priors that are necessary to complete the shape. In our representation, we associate a local coordinate system to each part and learn the distribution of positions and orientations of all the other parts from the database, which implicitly also defines positions of symmetry planes and symmetry axes. At the inference stage, this knowledge enables us to analyze incomplete point clouds with substantial occlusions, because observing only a few regions is still sufficient to infer the global structure. Once the parts and the symmetries are estimated, both data sources, symmetry and database, are fused to complete the point cloud. We evaluate our technique on a synthetic dataset containing 481 shapes, and on real scans acquired with a Kinect scanner. Our method demonstrates high accuracy for the estimated part structure and detected symmetries, enabling higher quality shape completions in comparison to alternative techniques.
Minhyuk Sung, Vladimir G. Kim, Roland Angst, Leonidas Guibas
Data-driven Structural Priors for Shape Completion
SIGGRAPH Asia 2015
Paper |
Supplementary material |
Slides(PPTX) |
Code
Bibtex
@article{Sung:2015,
author = {Sung, Minhyuk and Kim, Vladimir G. and Angst, Roland and Guibas, Leonidas},
title = {Data-driven Structural Priors for Shape Completion},
Journal = {ACM Transactions on Graphics (Proc. of SIGGRAPH Asia)},
year = {2015}
}
Data Download
Ground truth datasets (41.8MB)
Benchmark results (2.2GB)
Kinect scan data (27.7MB)
Benchmark Results
On the following linked webpages, we present several experimental results organized as tables, where each row corresponds to a model. The columns are as follows:
| Column Name | Content |
|---|---|
| View | The image viewed from the scanner. |
| Input | The acquired point cloud from a canonical view. |
| Structure | Estimated structure (using our method, [Shen et al. 2012], or [Podolak 2006]) |
| Accuracy | Completed shape where each point is colored according to the distance to the ground truth surface. Non-blue points indicate errors in completed point cloud. |
| Completeness | True shape where each point is colored according to the distance to the completed shape. Non-blue points indicate that occluded points were not added. |
We present results on the following datasets:
| Dataset | Ours | Shen et al. 2012 | Podolak et al. 2006 | Plot (Fig. 11 in paper) |
|---|---|---|---|---|
| Chairs (Shen et al.) | Ours | Shen et al. | Podolak et al. | Plot |
| Airplanes (Shen et al.) | Ours | Shen et al. | Podolak et al. | Plot |
| Bicycles (Shen et al.) | Ours | Shen et al. | Podolak et al. | Plot |
| Chairs (COSEG) | Ours | Shen et al. | Podolak et al. | Plot |
| Tables (ShapeNet) | Ours | Shen et al. | Podolak et al. | Plot |
We also present results in the presence of stronger occlusions simulated by a rectangle between the surface and the viewpoint (Fig. 12 in paper):
| Dataset | Ours | Shen et al. 2012 | Podolak et al. 2006 | Plot (Fig. 12 in paper) |
|---|---|---|---|---|
| Chairs (Shen et al.) | Ours | Shen et al. | Podolak et al. | Plot |
| Airplanes (Shen et al.) | Ours | Shen et al. | Podolak et al. | Plot |
| Bicycles (Shen et al.) | Ours | Shen et al. | Podolak et al. | Plot |
| Chairs (COSEG) | Ours | Shen et al. | Podolak et al. | Plot |
| Tables (ShapeNet) | Ours | Shen et al. | Podolak et al. | Plot |
Acknowledgements
This project was supported by NSF grants CCF 1011228, DMS 1228304, AFOSR grant FA9550-12-1-0372, ONR MURI grant N00014-13-1-0341, a Google Focused Research Award, the Korea Foundation for Advanced Studies, and the Max Planck Center for Visual Computing and Communications.
[Shen et al.2012] Chao-Hui Shen, Hongbo Fu, Kang Chen, and Shi-Min Hu, “Structure Recovery by Part Assembly”, SIGGRAPH Asia 2012.
[Podolak et al.2006] Joshua Podolak, Philip Shilane, Aleksey Golovinskiy, Szymon Rusinkiewicz, Thomas Funkhouser, “A Planar-Reflective Symmetry Transform for 3D Shapes”, SIGGRAPH 2006.
[COSEG] Oana Sidi, Oliver van Kaick, Yanir Kleiman, Hao Zhang, Daniel Cohen-Or, “Unsupervised Co-Segmentation of a Set of Shapes via Descriptor-Space Spectral Clustering”, SIGGRAPH Asia 2011.
[ShapeNet] http://shapenet.cs.stanford.edu/