TY - JOUR PY - 2016// TI - Context-aware fusion of RGB and thermal imagery for traffic monitoring JO - Sensors (Basel) A1 - Alldieck, Thiemo A1 - Bahnsen, Chris H. A1 - Moeslund, Thomas B. SP - s16111947 EP - s16111947 VL - 16 IS - 11 N2 - In order to enable a robust 24-h monitoring of traffic under changing environmental conditions, it is beneficial to observe the traffic scene using several sensors, preferably from different modalities. To fully benefit from multi-modal sensor output, however, one must fuse the data. This paper introduces a new approach for fusing color RGB and thermal video streams by using not only the information from the videos themselves, but also the available contextual information of a scene. The contextual information is used to judge the quality of a particular modality and guides the fusion of two parallel segmentation pipelines of the RGB and thermal video streams. The potential of the proposed context-aware fusion is demonstrated by extensive tests of quantitative and qualitative characteristics on existing and novel video datasets and benchmarked against competing approaches to multi-modal fusion.
Language: en
LA - en SN - 1424-8220 UR - http://dx.doi.org/10.3390/s16111947 ID - ref1 ER -