STIVi
Turning Perspective Sketching Videos into Interactive Tutorials
Capucine Nghiem (Université Paris-Saclay, Paris)
Adrien Bousseau (Université Côte d'Azur, TU Delft - Electrical Engineering, Mathematics and Computer Science)
Mark Sypesteyn (TU Delft - Industrial Design Engineering)
Jan Willem Hoftijzer (TU Delft - Industrial Design Engineering)
Maneesh Agrawala (Stanford University)
Theophanis Tsandilas (Université Paris-Saclay, Paris)
More Info
expand_more
Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.
Abstract
For design and art enthusiasts who seek to enhance their skills through instructional videos, following drawing instructions while practicing can be challenging. STIVi presents perspective drawing demonstrations and commentary of prerecorded instructional videos as interactive drawing tutorials that students can navigate and explore at their own pace. Our approach involves a semi-automatic pipeline to assist instructors in creating STIVi content by extracting pen strokes from video frames and aligning them with the accompanying audio commentary. Thanks to this structured data, students can navigate through transcript and in-video drawing, refer to provided highlights in both modalities to guide their navigation, and explore variations of the drawing demonstration to understand fundamental principles.
We evaluated STIVi’s interactive tutorials against a regular video player. We observed that our interface supports non-linear learning styles by providing students alternative paths for following and understanding drawing instructions.
help_outline