|
Infrared and visible image fusion aims to synthesize a new image with complementary information of the source images such as the thermal radiation information and detailed texture information. However, the existing methods applied in the image fusion tasks tend to pay more attention to the improvements of visual quality and multiple evaluation indicators, while ignoring the importance of semantic information in high-level missions of image processing. In this paper, we present a novel approach to image fusion, where the synthesis of fused images is achieved through the utilization of semantic layouts generated via unsupervised learning. With the introduction of Attention Mechanism, the relationships between each pair of pixel points are gained to construct soft semantic layouts and further capture the global context information to make the same kind of semantics show the same fusion effect. By leveraging the semantic information, our method enables the automatic learning of fusion weights for two source images at the same spatial position. In comparison with other state-of-the-art image fusion methods, our experimental results obtained excellent performance both on qualitative results and quantitative indicators. Moreover, our method retains the high-level semantic information to the greatest extent, which is one of our outstanding characteristics.
|
