Dialog detection in narrative video by shot and face analysis

Conference Paper (2007)
Contributor(s)

Copyright
© 2007 Kroon, B., Nesvadba, J., Hanjalic, A.
More Info
expand_more
Publication Year
2007
Copyright
© 2007 Kroon, B., Nesvadba, J., Hanjalic, A.
Related content
Reuse Rights

Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.

Abstract

The proliferation of captured personal and broadcast content in personal consumer archives necessitates comfortable access to stored audiovisual content. Intuitive retrieval and navigation solutions require however a semantic level that cannot be reached by generic multimedia content analysis alone. A fusion with film grammar rules can help to boost the reliability significantly. The current paper describes the fusion of low-level content analysis cues including face parameters and inter-shot similarities to segment commercial content into film grammar rule-based entities and subsequently classify those sequences into so-called shot reverse shots, i.e. dialog sequences. Moreover shot reverse shot specific mid-level cues are analyzed augmenting the shot reverse shot information with dialog specific descriptions.

Files

DialogKroon.pdf
(pdf | 1.3 Mb)
License info not available