MAT-Based 3D Shape Reconstruction and Animation Using Multi-View Sketches

Animating characters from sketches is an interesting but challenging task. Existing studies have proposed shape reconstruction methods or animating methods from sketches. However, they are not suitable for character design due to the lack of user controllability. In this paper, we propose a framework for reconstructing 3D shapes and creating animations from multi-view images and skeletons. Using Medial Axis Transform (MAT) representation, the shape can be reconstructed using an inverse rendering method while preserving the structure of the initial skeleton. In addition, we propose novel distance-transform style rendering and sketch style rendering methods using characteristics of MAT. Finally, we present methods for animation transfer and animation creation. Experimental results demonstrate that our framework can easily and quickly create 3D models and animation prototypes from character sketches.

* This project was published in a Korean academic journal in 2025.[paper]