|
基于图像张量与噪声建模的遥感图像复原
|
Abstract:
在高光谱图像(HSI)处理领域,一个核心问题是从各类退化现象中恢复HSI数据,诸如噪声污染及信息缺失等。然而,当前多数方法未能充分考量HSI的丰富先验信息及所含噪声,这在一定程度上限制了其实际应用效果。本文提出了一种新颖的HSI恢复方法,它结合了图像的内在结构和噪声特性,构建了一个基于低秩张量函数的模型。这个模型通过低秩张量分解来捕捉图像的全局结构,从而有效地利用图像的内在规律。同时,该模型还使用高斯混合模型来建模噪声的概率分布,这使得模型能够更好地适应不同类型和强度的噪声。在训练过程中,模型会综合考虑数据误差、图像平滑性约束以及负对数似然损失等多种因素。通过优化这些参数,模型能够进一步提高图像质量,实现清晰图像的恢复。在模拟和实际场景下的大量实验结果证明了所提方法的有效性以及其优于现有先进方法的优越性。
In the field of hyperspectral image (HSI) processing, a core challenge is recovering HSI data from various degradation phenomena, such as noise contamination and missing information. However, most existing methods fail to fully account for the rich prior information in HSIs and the characteristics of the noise, which to some extent limits their practical effectiveness. This paper proposes a novel HSI recovery method that integrates the intrinsic structure of images and noise characteristics by constructing a model based on low-rank tensor functions. This model leverages low-rank tensor decomposition to capture the global structure of the image, effectively utilizing the inherent patterns within the data. Simultaneously, the model employs a Gaussian mixture model to characterize the probabilistic distribution of the noise, allowing it to better adapt to various types and levels of noise. During the training process, the model comprehensively considers factors such as data fidelity, image smoothness constraints, and negative log-likelihood loss. By optimizing these parameters, the model can further enhance image quality and achieve clear image recovery. Extensive experiments conducted in both simulated and real-world scenarios demonstrate the effectiveness of the proposed method and its superiority over state-of-the-art approaches.
[1] | Meng, D. and De la Torre, F. (2013) Robust Matrix Factorization with Unknown Noise. 2013 IEEE International Conference on Computer Vision, Sydney, 1-8 December 2013, 1337-1344. https://doi.org/10.1109/iccv.2013.169 |
[2] | Zhao, Q., Meng, D.Y., Xu, Z.B., Zuo, W.M. and Yan, Y. (2015) L1-Norm Low-Rank Matrix Factorization by Variational Bayesian Method. IEEE Transactions on Neural Networks and Learning Systems, 26, 825-839. https://doi.org/10.1109/tnnls.2014.2387376 |
[3] | He, W., Zhang, H., Shen, H. and Zhang, L. (2018) Hyperspectral Image Denoising Using Local Low-Rank Matrix Recovery and Global Spatial-Spectral Total Variation. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 11, 713-729. https://doi.org/10.1109/jstars.2018.2800701 |
[4] | Zhao, Y.Q. and Yang, J.X. (2015) Hyperspectral Image Denoising via Sparse Representation and Low-Rank Constraint. IEEE Transactions on Geoscience and Remote Sensing, 53, 296-308. https://doi.org/10.1109/tgrs.2014.2321557 |
[5] | Liu, J., Musialski, P., Wonka, P. and Ye, J. (2013) Tensor Completion for Estimating Missing Values in Visual Data. IEEE Transactions on Pattern Analysis and Machine Intelligence, 35, 208-220. https://doi.org/10.1109/tpami.2012.39 |
[6] | Tucker, L.R. (1966) Some Mathematical Notes on Three-Mode Factor Analysis. Psychometrika, 31, 279-311. https://doi.org/10.1007/bf02289464 |
[7] | Carroll, J.D. and Chang, J. (1970) Analysis of Individual Differences in Multidimensional Scaling via an N-Way Generalization of “Eckart-Young” Decomposition. Psychometrika, 35, 283-319. https://doi.org/10.1007/bf02310791 |
[8] | Zhao, Q., Zhang, L. and Cichocki, A. (2015) Bayesian CP Factorization of Incomplete Tensors with Automatic Rank Determination. IEEE Transactions on Pattern Analysis and Machine Intelligence, 37, 1751-1763. https://doi.org/10.1109/tpami.2015.2392756 |
[9] | Chang, Y., Yan, L., Zhao, X., Fang, H., Zhang, Z. and Zhong, S. (2020) Weighted Low-Rank Tensor Recovery for Hyperspectral Image Restoration. IEEE Transactions on Cybernetics, 50, 4558-4572. https://doi.org/10.1109/tcyb.2020.2983102 |
[10] | Xie, Q., Zhao, Q., Meng, D. and Xu, Z. (2018) Kronecker-Basis-Representation Based Tensor Sparsity and Its Applications to Tensor Recovery. IEEE Transactions on Pattern Analysis and Machine Intelligence, 40, 1888-1902. https://doi.org/10.1109/tpami.2017.2734888 |
[11] | He, W., Yao, Q., Li, C., Yokoya, N. and Zhao, Q. (2019) Non-local Meets Global: An Integrated Paradigm for Hyperspectral Denoising. 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, 15-20 June 2019, 6861-6870. https://doi.org/10.1109/cvpr.2019.00703 |
[12] | Luo, Y., Zhao, X., Meng, D. and Jiang, T. (2022) HLRTF: Hierarchical Low-Rank Tensor Factorization for Inverse Problems in Multi-Dimensional Imaging. 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), New Orleans, 18-24 June 2022, 19281-19290. https://doi.org/10.1109/cvpr52688.2022.01870 |
[13] | Peng, J., Wang, Y., Zhang, H., Wang, J. and Meng, D. (2022) Exact Decomposition of Joint Low Rankness and Local Smoothness Plus Sparse Matrices. IEEE Transactions on Pattern Analysis and Machine Intelligence, 45, 5766-5781. https://doi.org/10.1109/tpami.2022.3204203 |
[14] | Zheng, Y., Huang, T., Zhao, X., Chen, Y. and He, W. (2020) Double-Factor-Regularized Low-Rank Tensor Factorization for Mixed Noise Removal in Hyperspectral Image. IEEE Transactions on Geoscience and Remote Sensing, 58, 8450-8464. https://doi.org/10.1109/tgrs.2020.2987954 |
[15] | Luo, Y., Zhao, X., Jiang, T., Chang, Y., Ng, M.K. and Li, C. (2022) Self-Supervised Nonlinear Transform-Based Tensor Nuclear Norm for Multi-Dimensional Image Recovery. IEEE Transactions on Image Processing, 31, 3793-3808. https://doi.org/10.1109/tip.2022.3176220 |
[16] | Peng, J., Xie, Q., Zhao, Q., Wang, Y., Yee, L. and Meng, D. (2020) Enhanced 3DTV Regularization and Its Applications on HSI Denoising and Compressed Sensing. IEEE Transactions on Image Processing, 29, 7889-7903. https://doi.org/10.1109/tip.2020.3007840 |
[17] | Kargas, N. and Sidiropoulos, N.D. (2021) Supervised Learning and Canonical Decomposition of Multivariate Functions. IEEE Transactions on Signal Processing, 69, 1097-1107. https://doi.org/10.1109/tsp.2021.3055000 |
[18] | Burger, H.C., Schuler, C.J. and Harmeling, S. (2012) Image Denoising: Can Plain Neural Networks Compete with BM3D? 2012 IEEE Conference on Computer Vision and Pattern Recognition, Providence, 16-21 June 2012, 2392-2399. https://doi.org/10.1109/cvpr.2012.6247952 |
[19] | Zhang, K., Zuo, W. and Zhang, L. (2018) FFDNet: Toward a Fast and Flexible Solution for CNN-Based Image Denoising. IEEE Transactions on Image Processing, 27, 4608-4622. https://doi.org/10.1109/tip.2018.2839891 |
[20] | Liu, X., Bourennane, S. and Fossati, C. (2012) Denoising of Hyperspectral Images Using the PARAFAC Model and Statistical Performance Analysis. IEEE Transactions on Geoscience and Remote Sensing, 50, 3717-3724. https://doi.org/10.1109/tgrs.2012.2187063 |