Multimodal Input-Dependent Object Query Initialization for LiDAR-Camera 3D Object Detection with Transformers

3D object detection models that exploit both LiDAR and camera sensor features are top performers in large-scale autonomous driving benchmarks. A transformer is a popular network architecture used for this task, in which so-called object queries act as candidate objects. Initializing these object queries based on current sensor inputs leads to...