Repository hosted by TU Delft Library

Home · Contact · About · Disclaimer ·

Perceptual evaluation of different image fusion schemes

Publication files not online:

Author: Toet, A. · Franken, E.M.
Source:Displays, 1, 24, 25-37
Identifier: 11770
doi: doi:10.1016/S0141-9382(02)00069-0
Keywords: Vision · Infrared imaging · Traffic · Image fusion · Intensified imagery · Situational awareness · Night driving · Band structure · Cameras · Charge coupled devices · Sensory perception · Vehicle locating systems · Gesture recognition


Human scene recognition performance was tested with images of night-time outdoor scenes. The scenes were registered both with a dual band (visual and near infrared) image intensified low-light CCD camera (DII) and with a thermal middle wavelength band (3–5 mm) infrared (IR) camera. Fused imagery was produced through a grayscale pyramid image merging scheme, in combination with two different colour mappings. Observer performance was tested for each of the (individual and fused) image modalities. The results show that DII imagery contributes most to global scene recognition (situational awareness), whereas IR imagery serves best for the detection and recognition of targets like humans and vehicles. Grayscale fused imagery yields appreciable performance levels in most conditions. With an appropriate colour mapping, colour fused imagery yields the best overall scene recognition performance. However, an inappropriate colour mapping significantly decreases observer performance compared to grayscale image fusion. The deployment of a DII system in addition to a 3-5 mu IR system through image fusion can increase the performance of human observers when the colour mapping relates to the nature of the visual task and the conditions (scene content) at hand.