Skip to main content

Sketch-based modeling with a differentiable renderer.

Xiang, N., Wang, R., Jiang, T., Wang, L., Li, Y., Yang, X. and Zhang, J., 2020. Sketch-based modeling with a differentiable renderer. Computer Animation and Virtual Worlds, 31 (4-5), e1939.

Full text available as:

cav.1939.pdf - Published Version
Available under License Creative Commons Attribution.


DOI: 10.1002/cav.1939


© 2020 The Authors. Computer Animation and Virtual Worlds published by John Wiley & Sons, Ltd. Sketch-based modeling aims to recover three-dimensional (3D) shape from two-dimensional line drawings. However, due to the sparsity and ambiguity of the sketch, it is extremely challenging for computers to interpret line drawings of physical objects. Most conventional systems are restricted to specific scenarios such as recovering for specific shapes, which are not conducive to generalize. Recent progress of deep learning methods have sparked new ideas for solving computer vision and pattern recognition issues. In this work, we present an end-to-end learning framework to predict 3D shape from line drawings. Our approach is based on a two-steps strategy, it converts the sketch image to its normal image, then recover the 3D shape subsequently. A differentiable renderer is proposed and incorporated into this framework, it allows the integration of the rendering pipeline with neural networks. Experimental results show our method outperforms the state-of-art, which demonstrates that our framework is able to cope with the challenges in single sketch-based 3D shape modeling.

Item Type:Article
Uncontrolled Keywords:deep-learning; shape prediction; sketch‐based modeling
ID Code:34480
Deposited By: Symplectic RT2
Deposited On:02 Sep 2020 09:20
Last Modified:30 May 2023 15:05


Downloads per month over past year

More statistics for this item...
Repository Staff Only -