TY - JOUR

T1 - Tensor-based keypoint detection and switching regression model for relative radiometric normalization of bitemporal multispectral images

AU - Moghimi, Armin

AU - Celik, Turgay

AU - Mohammadzadeh, Ali

N1 - Funding Information: The author(s) reported there is no funding associated with the work featured in this article.

PY - 2022

Y1 - 2022

N2 - In some remote sensing applications, such as unsupervised change detection, bitemporal multispectral images must be first aligned/harmonized radiometrically. For doing so, Many Relative Radiometric Normalization (RRN) algorithms exist; however, most suffer from misregistration problems and can only operate on geo/co-registered image pairs, while unregistered multispectral pairs are required. To tackle this situation, keypoint-based RRN methods were introduced, which can radiometrically calibrate unregistered/registered image pairs using keypoint matching algorithms. However, they ignore the spatial and spectral characteristics of spectral bands of input images, resulting in potential RRN errors. They also employ a linear mapping function for RRN modelling, which can not handle non-linear radiometric distortions. To address these limitations, this paper proposes a robust algorithm for RRN of bitemporal multispectral images, using a new extension of SURF detector for multispectral images, namely the Weighted Spectral Structure Tensor SURF (WSST-SURF), and a flexible Switching Regression (SR) model. Taking advantage of the tensor theory, WSST-SURF efficiently preserves both spatial and spectral information distributed over all bands of multispectral images for keypoint detection, resulting in extracting reliable inliers (or keypoints) for RRN. An adaptive SR model is introduced based on the normalized mutual information, accurately approximating a linear/non-linear relationship between inliers in multispectral images. Six unregistered multispectral image pairs captured by inter/intra remote sensing sensors were employed to validate the efficacy of the proposed method. The results indicate that adopting spectral tensor-based SURF methods in the RRN process exhibits better local and global performance than using the original SURF. Furthermore, the proposed method outperforms the existing conventional RRN methods in terms of accuracy and visual quality, indicating its competence for RRN of bitemporal multispectral images with high illumination, viewpoint, and scale differences.

AB - In some remote sensing applications, such as unsupervised change detection, bitemporal multispectral images must be first aligned/harmonized radiometrically. For doing so, Many Relative Radiometric Normalization (RRN) algorithms exist; however, most suffer from misregistration problems and can only operate on geo/co-registered image pairs, while unregistered multispectral pairs are required. To tackle this situation, keypoint-based RRN methods were introduced, which can radiometrically calibrate unregistered/registered image pairs using keypoint matching algorithms. However, they ignore the spatial and spectral characteristics of spectral bands of input images, resulting in potential RRN errors. They also employ a linear mapping function for RRN modelling, which can not handle non-linear radiometric distortions. To address these limitations, this paper proposes a robust algorithm for RRN of bitemporal multispectral images, using a new extension of SURF detector for multispectral images, namely the Weighted Spectral Structure Tensor SURF (WSST-SURF), and a flexible Switching Regression (SR) model. Taking advantage of the tensor theory, WSST-SURF efficiently preserves both spatial and spectral information distributed over all bands of multispectral images for keypoint detection, resulting in extracting reliable inliers (or keypoints) for RRN. An adaptive SR model is introduced based on the normalized mutual information, accurately approximating a linear/non-linear relationship between inliers in multispectral images. Six unregistered multispectral image pairs captured by inter/intra remote sensing sensors were employed to validate the efficacy of the proposed method. The results indicate that adopting spectral tensor-based SURF methods in the RRN process exhibits better local and global performance than using the original SURF. Furthermore, the proposed method outperforms the existing conventional RRN methods in terms of accuracy and visual quality, indicating its competence for RRN of bitemporal multispectral images with high illumination, viewpoint, and scale differences.

KW - keypoint extraction

KW - Multispectral image

KW - Relative Radiometric Normalization (RRN)

KW - Speeded-Up Robust Features (SURF)

KW - Unregistered image pair

KW - Weighted Spectral Structure Tensor-SURF (WSST-SURF)

UR - http://www.scopus.com/inward/record.url?scp=85135918756&partnerID=8YFLogxK

U2 - 10.1080/01431161.2022.2102951

DO - 10.1080/01431161.2022.2102951

M3 - Article

AN - SCOPUS:85135918756

VL - 43

SP - 3927

EP - 3956

JO - International Journal of Remote Sensing

JF - International Journal of Remote Sensing

SN - 0143-1161

IS - 11

ER -