Structure Recovery by Part Assembly

ACM Transaction on Graphics (Proceedings of SIGGRAPH Asia 2012)

  Chao-Hui Shen1    Hongbo Fu2     Kang Chen1      Shi-Min Hu1  

1Tsinghua University        2City Univ. of Hong Kong     


Given single-view scans by the Kinect system, containing highly noisy and incomplete 3D scans (upper left) and corresponding RGB images (lower left), our approach is able to faithfully recover their underlying structures (yellow) by assembling suitable parts (red) in the repository models (blue).

This paper presents a technique that allows quick conversion of acquired low-quality data from consumer-level scanning devices to high-quality 3D models with labeled semantic parts and meanwhile their assembly reasonably close to the underlying geometry. This is achieved by a novel structure recovery approach that is essentially local to global and bottom up, enabling the creation of new structures by assembling existing labeled parts with respect to the acquired data. We demonstrate that using only a small-scale shape repository, our part assembly approach is able to faithfully recover a variety of high-level structures from only a single-view scan of man-made objects acquired by the Kinect system, containing a highly noisy, incomplete 3D point cloud and a corresponding RGB image.
Slides Fast Forward, Paper Presentation

Download the video (.avi; ~22M)



The result gallery generated using our part assembly approach for structure recovery from a single-view scan of man-made objects acquired by the Kinect system of Microsoft. Parts borrowed from different repository models are shown in different colors.

@article {Shen:2012,
  author = {Shen, Chao-Hui and Fu, Hongbo and Chen, Kang and Hu, Shi-Min},
  title = {Structure Recovery by Part Assembly},
  journal = {ACM Transactions on Graphics (Proceedings of ACM SIGGRAPH Asia 2012},
  year = {2012}
  volume = {31}
  number = {6}
Thanks We thank the anonymous reviewers for their constructive comments. This work was partially supported by grants from the National Basic Research Project of China (Project No. 2011CB302203), the Natural Science Foundation of China (Project No. 61120106007), the National High Technology Research and Development Program of China (Project No. 2012AA011801), the Research Grants Council of HKSAR (Project No. 113610), and the City University of Hong Kong (Project No. SRG7002776).
Another project page maintained by Chao-Hui Shen