MotionDreamer

Exploring Semantic Video Diffusion Features for Zero-Shot 3D Mesh Animation

Conference Paper (2025)
Author(s)

Lukas Uzolas (TU Delft - Electrical Engineering, Mathematics and Computer Science)

Elmar Eisemann (TU Delft - Electrical Engineering, Mathematics and Computer Science)

Petr Kellnhofer (TU Delft - Electrical Engineering, Mathematics and Computer Science)

Research Group
Computer Graphics and Visualisation
DOI related publication
https://doi.org/10.1109/3DV66043.2025.00087 Final published version
More Info
expand_more
Publication Year
2025
Language
English
Research Group
Computer Graphics and Visualisation
Pages (from-to)
893-904
Publisher
IEEE
ISBN (electronic)
9798331538514
Event
12th International Conference on 3D Vision, 3DV 2025 (2025-03-25 - 2025-03-28), Singapore, Singapore
Page Views
97
Reuse Rights

Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.

Abstract

Animation techniques bring digital 3D worlds and characters to life. However, manual animation is tedious and automated techniques are often specialized to narrow shape classes. In our work, we propose a technique for automatic re-animation of various 3D shapes based on a motion prior extracted from a video diffusion model. Unlike existing $4 D$ generation methods, we focus solely on the motion, and we leverage an explicit mesh-based representation compatible with existing computer-graphics pipelines. Furthermore, our utilization of diffusion features enhances accuracy of our motion fitting. We analyze efficacy of these features for animation fitting and we experimentally validate our approach for two different diffusion models and four animation models. Finally, we demonstrate that our time-efficient zero-shot method achieves a superior performance re-animating a diverse set of 3D shapes when compared to existing techniques in a user study.

Files

MotionDreamer_Exploring_Semant... (pdf)
(pdf | 3.89 Mb)
- Embargo expired in 25-02-2026
– Personal use only – Dutch Copyright Act (Article 25fa)