基于VGG网络的双波段图像融合方法
DOI:
作者:
作者单位:

作者简介:

通讯作者:

中图分类号:

基金项目:


Dual-band image fusion method based on VGGNet
Author:
Affiliation:

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    针对红外与可见光图像中物体信息具有各自优点的情况,提出了基于VGG网络的红外与可见光图像融合方法来提高对夜间或复杂背景情况下的物体检测识别能力。首先将图像分别输入到一个经过训练得到的VGG网络中,经过不同的卷积层提取各自的特征图;然后将特征图经过ZCA白化处理,去除冗余信息;再通过归一化处理,将特征图的维度降到二维,并通过双三次插值法将其缩放到与源图像尺寸一致;最后通过加权取平均得到融合后的图像。实验结果表明,本文的方法在第四和第五层卷积得到的融合结果优于前三层的融合结果。同时,本文融合方法与其他3种融合方法相比视觉效果较好,在标准差、平均梯度、相关系数、熵值等评价指标上分别平均提升了12.79 %、11.04 %、9.94 %和2.54 %,并且在融合时间上保持在1秒以内。这说明该方法融合效果较好,速度较快,能够较多地保留红外与可见光图像信息和较好地提升目标的显著性。

    Abstract:

    In view of the fact that the object information in infrared and visible images has its own advantages,an infrared and visible image fusion method based on VGGNet is proposed to improve the detection and recognition ability of objects in night or complex background.Firstly,the source images were input into a trained VGGNet and the feature maps were extracted by different convolution layers.Then the feature maps were removed redundant information by ZCA whitening.The dimension of the feature map was reduced to two dimensions by normalization,and they were resized to the same size as the source images by bicubic interpolation.Finally,the fused images were obtained by weighted average.Experimental results indicate that the fusion results of the fourth and fifth convolution layers are superior to those of the first three layers in our method.Meanwhile,the fusion method presented in this paper has better visual effects than the other three fusion methods,with an average increase of 12.79 %,11.04 %,9.94 % and 2.54 % in the standard deviation,average gradient,correlation and entropy,and the fusion time is kept within 1 second.This indicates that the method in this paper has better fusion effect and faster fusion speed,and can retain more infrared and visible image information and improve the target significantly.

    参考文献
    相似文献
    引证文献
引用本文

马旗,朱斌,张宏伟.基于VGG网络的双波段图像融合方法[J].激光与红外,2019,49(11):1374~1380
MA Qi, ZHU Bin, ZHANG Hong-wei. Dual-band image fusion method based on VGGNet[J]. LASER & INFRARED,2019,49(11):1374~1380

复制
分享
文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:
  • 最后修改日期:
  • 录用日期:
  • 在线发布日期: 2019-12-03
  • 出版日期: