Infrared dim small target tracking based on side window filtering and spatial-temporal regularized correlation filters
-
摘要: 当目标远离红外系统，其在成像图像上的尺寸较小且信息量较少，使得小目标的持续精确定位成为一项有挑战性的问题。针对这一问题，在相关滤波跟踪框架上，引入能够区分红外弱小目标边缘信息与杂波噪声的侧窗图像滤波方法，提出了一种弱小目标跟踪算法。具体来说，首先利用时空正则化的相关滤波跟踪模型，对目标位置附近更大范围的背景进行考虑。然后，利用侧窗滤波对当前局部搜索区域进行侧窗滤波处理，达到了保留边缘效果的同时剔除了图像噪声。最后，通过原始图像与滤波后图像作差，降低了背景边缘对目标定位错误的影响，并实现小目标状态估计。为验证本文所提算法性能，采用六组红外真实弱小目标图像序列进行实验，并与核相关滤波、空间正则化的相关滤波，以及时空正则化的相关滤波等经典算法作比较。实验结果表明，所提算法在多组复杂背景的图像序列上，获得了较高的跟踪精度，验证了所提算法能有效应对红外弱小目标跟踪任务中的快速运动、低分辨率和强背景杂波等问题。Abstract: Due to the less information of distant target, it is always challenging to accurately track the target in the task of infrared dim small target tracking. To improve the accuracy, based on correlation filtering framework, the side window filtering method which can extract the edge features of small infrared target is introduced, and an algorithm of distant target tracking is proposed. Specifically, the side window filtering method is used to process the searching area of the current target, this method could restrain the negative influence of background edge on dim small target location. Next, the correlation filters tracking model is constructed with temporal and spatial regularities to achieve accurate target tracking. To verify the performance of the proposed algorithm, six groups of real infrared dim small target image sequences were used for experiments, and the algorithm is compared with other typical algorithms such as KCF, SRDCF and STRCF. The experimental results show that the algorithm could effectively solve the problems of fast motion, low resolution and strong light background in infrared dim small target tracking tasks, getting higher accuracy with image sequences and complex background.
-
表 1 算法性能对比
Table 1. Comparison of algorithm performance
sequence precision/%（E=5） KCF SRDCF STRCF this paper sequence.1 35 65 98 99 sequence.2 81 58 95 95 sequence.3 82 98 64 94 sequence.4 97 98 17 98 sequence.5 31 9 15 58 sequence.6 62 32 100 100 average 65 60 65 91 
下载: 导出CSV
-
[1] Jennings D E, Jhabvala M D, Tucker C J, et al. Compact thermal imager: a flight demonstration of infrared technology for Earth observations[J]. Applied Optics, 2022, 61(14): 4215-4225. doi: 10.1364/AO.450442 [2] Zhang Landan, Peng Zhenming. Infrared small target detection based on partial sum of the tensor nuclear norm[J]. Remote Sensing, 2019, 11: 382. doi: 10.3390/rs11040382 [3] Qiu Zhaobing, Ma Yong, Fan Fan, et al. A pixel-level local contrast measure for infrared small target detection[J]. Defence Technology, 2022, 18(9): 1589-1601. doi: 10.1016/j.dt.2021.07.002 [4] Wan Minjie, Ye Xiaobo, Zhang Xiaojie, et al. Infrared small target tracking via Gaussian curvature-based compressive convolution feature extraction[J]. IEEE Geoscience and Remote Sensing Letters, 2022, 19: 7000905. [5] Dong Xiabin, Huang Xinsheng, Zheng Yongbin, et al. Infrared dim and small target detecting and tracking method inspired by Human Visual System[J]. Infrared Physics & Technology, 2014, 62: 100-109. [6] Ding Lianghui, Xu Xin, Cao Yuan, et al. Detection and tracking of infrared small target by jointly using SSD and pipeline filter[J]. Digital Signal Processing, 2021, 110: 102949. doi: 10.1016/j.dsp.2020.102949 [7] Tian Mengchu, Chen Zhimin, Wang Huifen, et al. An intelligent particle filter for infrared dim small target detection and tracking[J]. IEEE Transactions on Aerospace and Electronic Systems, 2022, 58(6): 5318-5333. doi: 10.1109/TAES.2022.3169447 [8] Chen Zhimin, Tian Mengchu, Bo Yuming et al. Improved infrared small target detection and tracking method based on new intelligence particle filter[J]. Computational Intelligence, 2018, 34(3): 917-938. doi: 10.1111/coin.12150 [9] Chen Jian, Lin Yanming, Huang Detian, et al. Robust tracking algorithm for infrared target via correlation filter and particle filter[J]. Infrared Physics & Technology, 2020, 111: 103516. [10] Wang Zhile, Hou Qingyu, Hao Ling. Improved infrared target-tracking algorithm based on mean shift[J]. Applied Optics, 2012, 51(21): 5051-5059. doi: 10.1364/AO.51.005051 [11] 侯晴宇, 卞春江, 逯力红, 等. 红外图像中快速小目标的均值移位跟踪[J]. 哈尔滨工业大学学报, 2013, 45(4):79-83 doi: 10.11918/j.issn.0367-6234.2013.04.015Hou Qingyu, Bian Chunjiang, Lu Lihong, et al. Mean shift tracking for fast small target in IR imagery[J]. Journal of Harbin Institute of Technology, 2013, 45(4): 79-83 doi: 10.11918/j.issn.0367-6234.2013.04.015 [12] Kwan C, Budavari B. Enhancing small moving target detection performance in low-quality and long-range infrared videos using optical flow techniques[J]. Remote Sensing, 2020, 12: 4024. doi: 10.3390/rs12244024 [13] Soolmaz A, Mehdi R. Visual object tracking using similarity transformation and adaptive optical flow[J]. Multimedia Tools and Applications, 2021, 80(24): 33455-33473. doi: 10.1007/s11042-021-11344-7 [14] Bolme D S, Beveridge J R, Draper B A, et al. Visual object tracking using adaptive correlation filters[C]//Proceedings of 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. 2010: 2544-2550. [15] Henriques J F, Caseiro R, Martins P, et al. High-speed tracking with Kernelized correlation filters[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2015, 37(3): 583-596. doi: 10.1109/TPAMI.2014.2345390 [16] Danelljan M, Häger G, Khan F S, et al. Learning spatially regularized correlation filters for visual tracking[C]//Proceedings of 2015 IEEE International Conference on Computer Vision. 2015: 4310-4318. [17] Li Feng, Tian Cheng, Zuo Wangmeng, et al. Learning spatial-temporal regularized correlation filters for visual tracking[C]//Proceedings of 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2018: 4904-4913. [18] Bins J, Dihl L L, Jung C R. Target tracking using multiple patches and weighted vector median filters[J]. Journal of Mathematical Imaging and Vision, 2013, 45(3): 293-307. doi: 10.1007/s10851-012-0354-y [19] Yin Hui, Gong Yuanhao, Qiu Guoping. Side window filtering[C]//Proceedings of 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2019: 8750-8758. [20] Pedersen M S, Baxter K, Templeton B, et al. The matrix cookbook[M]. Denmark: Technical University of Denmark, 2008: 7-15. [21] Gao Chenqiang, Meng Deyu, Yang Yi, et al. Infrared patch-image model for small target detection in a single image[J]. IEEE Transactions on Image Processing, 2013, 22(12): 4996-5009. doi: 10.1109/TIP.2013.2281420 [22] Qian Kun, Zhou Huixin, Rong Shenghui, et al. Infrared dim-small target tracking via singular value decomposition and improved Kernelized correlation filter[J]. Infrared Physics & Technology, 2017, 82: 18-27. [23] 回丙伟, 宋志勇, 范红旗, 等. 地/空背景下红外图像弱小飞机目标检测跟踪数据集[J]. 中国科学数据, 2020, 5(3):291-302Hui Bingwei, Song Zhiyong, Fan Hongqi, et al. A dataset for infrared detection and tracking of dim-small aircraft targets under ground/air background[J]. China Scientific Data, 2020, 5(3): 291-302 [24] Liu Qiao, He Zhenyu, Li Xin, et al. PTB-TIR: a thermal infrared pedestrian tracking benchmark[J]. IEEE Transactions on Multimedia, 2020, 22(3): 666-675. doi: 10.1109/TMM.2019.2932615 -
点击查看大图
图(4) / 表(1)
计量
- 文章访问数: 636
- HTML全文浏览量: 268
- PDF下载量: 89
- 被引次数: 0
