Offline Tracking with Object Permanence

Conference Paper (2024)
Author(s)

X. Liu (Student TU Delft)

Holger Caesar (TU Delft - Intelligent Vehicles)

Research Group
Intelligent Vehicles
DOI related publication
https://doi.org/10.1109/IV55156.2024.10588572
More Info
expand_more
Publication Year
2024
Language
English
Research Group
Intelligent Vehicles
Pages (from-to)
1272-1279
Publisher
IEEE
ISBN (electronic)
979-8-3503-4881-1
Reuse Rights

Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.

Abstract

To reduce the expensive labor costs of manually labeling autonomous driving datasets, an alternative is to automatically label the datasets using an offline perception system. However, objects might be temporarily occluded. Such occlusion scenarios in the datasets are common yet underexplored in offline auto labeling. In this work, we propose an offline tracking model that focuses on occluded object tracks. It leverages the concept of object permanence, which means objects continue to exist even if they are not observed anymore. The model contains three parts: a standard online tracker, a re-identification (Re-ID) module that associates tracklets before and after occlusion, and a track completion module that completes the fragmented tracks. The Re-ID module and the track completion module use the vectorized lane map as a prior to refine the tracking results with occlusion. The model can effectively recover the occluded object trajectories. It significantly improves the original online tracking result, demonstrating its potential to be applied in offline auto labeling as a useful plugin to improve tracking by recovering occlusions.

Files

Offline_Tracking_with_Object_P... (pdf)
(pdf | 2.1 Mb)
- Embargo expired in 15-01-2025
Taverne