Sketch2Scene : Sketch-based Co-retrieval and Co-placement of 3D Models

Abstract: This work presents Sketch2Scene, a framework that automatically turns a freehand sketch drawing inferring multiple scene objects to semantically valid, well arranged scenes of 3D models. Unlike the existing works on sketch-based search and composition of 3D models, which typically process individual sketched objects one by one, our technique performs co-retrieval and co-placement of 3D relevant models by jointly processing the sketched objects. This is enabled by summarizing functional and spatial relationships among models in a large collection of 3D scenes as structural groups. Our technique greatly reduces the amount of user intervention needed for sketch-based modeling of 3D scenes and fits well into the traditional production pipeline involving concept design followed by 3D modeling. A pilot study indicates that it is promising to use our technique as an alternative but more efficient tool of standard 3D modeling for 3D scene construction.

• Paper: [PDF 6.1M]
• Presentation: [PPTX]
• Supplemental Document: [PDF 4.4M]
• Supplemental Video: [AVI 12.5M]

Bibtex: @article{Xu13sig,

author = {Kun Xu and Kang Chen and Hongbo Fu and Wei-Lun Sun and Shi-Min Hu},
title = {Sketch2Scene: Sketch-based Co-retrieval and Co-placement of 3D Models},
journal = {ACM Transactions on Graphics},
volume = {32},
number = {4},
year = {2013},
pages = {to appear},
}