Coastal Aquaculture Extraction Using GF-3 Fully Polarimetric SAR Imagery: A Framework Integrating UNet++ with Marker-Controlled Watershed Segmentation

Research output: Contribution to journalArticleResearchpeer review

Authors

  • Juanjuan Yu
  • Xiufeng He
  • Peng Yang
  • Mahdi Motagh
  • Jia Xu
  • Jiacheng Xiong

External Research Organisations

  • Hohai University
  • Helmholtz Centre Potsdam - German Research Centre for Geosciences (GFZ)
View graph of relations

Details

Original languageEnglish
Article number2246
JournalRemote sensing
Volume15
Issue number9
Publication statusPublished - 24 Apr 2023

Abstract

Coastal aquaculture monitoring is vital for sustainable offshore aquaculture management. However, the dense distribution and various sizes of aquacultures make it challenging to accurately extract the boundaries of aquaculture ponds. In this study, we develop a novel combined framework that integrates UNet++ with a marker-controlled watershed segmentation strategy to facilitate aquaculture boundary extraction from fully polarimetric GaoFen-3 SAR imagery. First, four polarimetric decomposition algorithms were applied to extract 13 polarimetric scattering features. Together with the nine other polarisation and texture features, a total of 22 polarimetric features were then extracted, among which four were optimised according to the separability index. Subsequently, to reduce the “adhesion” phenomenon and separate adjacent and even adhering ponds into individual aquaculture units, two UNet++ subnetworks were utilised to construct the marker and foreground functions, the results of which were then used in the marker-controlled watershed algorithm to obtain refined aquaculture results. A multiclass segmentation strategy that divides the intermediate markers into three categories (aquaculture, background and dikes) was applied to the marker function. In addition, a boundary patch refinement postprocessing strategy was applied to the two subnetworks to extract and repair the complex/error-prone boundaries of the aquaculture ponds, followed by a morphological operation that was conducted for label augmentation. An experimental investigation performed to extract individual aquacultures in the Yancheng Coastal Wetlands indicated that the crucial features for aquacultures are Shannon entropy (SE), the intensity component of SE (SE_I) and the corresponding mean texture features (Mean_SE and Mean_SE_I). When the optimal features were introduced, our proposed method performed better than standard UNet++ in aquaculture extraction, achieving improvements of 1.8%, 3.2%, 21.7% and 12.1% in F1, IoU, MR and insF1, respectively. The experimental results indicate that the proposed method can handle the adhesion of both adjacent objects and unclear boundaries effectively and capture clear and refined aquaculture boundaries.

Keywords

    boundary patch refinement, coastal aquaculture, deep learning, GF-3 fully polarimetric, marker-controlled watershed

ASJC Scopus subject areas

Cite this

Coastal Aquaculture Extraction Using GF-3 Fully Polarimetric SAR Imagery: A Framework Integrating UNet++ with Marker-Controlled Watershed Segmentation. / Yu, Juanjuan; He, Xiufeng; Yang, Peng et al.
In: Remote sensing, Vol. 15, No. 9, 2246, 24.04.2023.

Research output: Contribution to journalArticleResearchpeer review

Download
@article{28bbc87aae4844ab9b58b3b8e3c7f4e0,
title = "Coastal Aquaculture Extraction Using GF-3 Fully Polarimetric SAR Imagery: A Framework Integrating UNet++ with Marker-Controlled Watershed Segmentation",
abstract = "Coastal aquaculture monitoring is vital for sustainable offshore aquaculture management. However, the dense distribution and various sizes of aquacultures make it challenging to accurately extract the boundaries of aquaculture ponds. In this study, we develop a novel combined framework that integrates UNet++ with a marker-controlled watershed segmentation strategy to facilitate aquaculture boundary extraction from fully polarimetric GaoFen-3 SAR imagery. First, four polarimetric decomposition algorithms were applied to extract 13 polarimetric scattering features. Together with the nine other polarisation and texture features, a total of 22 polarimetric features were then extracted, among which four were optimised according to the separability index. Subsequently, to reduce the “adhesion” phenomenon and separate adjacent and even adhering ponds into individual aquaculture units, two UNet++ subnetworks were utilised to construct the marker and foreground functions, the results of which were then used in the marker-controlled watershed algorithm to obtain refined aquaculture results. A multiclass segmentation strategy that divides the intermediate markers into three categories (aquaculture, background and dikes) was applied to the marker function. In addition, a boundary patch refinement postprocessing strategy was applied to the two subnetworks to extract and repair the complex/error-prone boundaries of the aquaculture ponds, followed by a morphological operation that was conducted for label augmentation. An experimental investigation performed to extract individual aquacultures in the Yancheng Coastal Wetlands indicated that the crucial features for aquacultures are Shannon entropy (SE), the intensity component of SE (SE_I) and the corresponding mean texture features (Mean_SE and Mean_SE_I). When the optimal features were introduced, our proposed method performed better than standard UNet++ in aquaculture extraction, achieving improvements of 1.8%, 3.2%, 21.7% and 12.1% in F1, IoU, MR and insF1, respectively. The experimental results indicate that the proposed method can handle the adhesion of both adjacent objects and unclear boundaries effectively and capture clear and refined aquaculture boundaries.",
keywords = "boundary patch refinement, coastal aquaculture, deep learning, GF-3 fully polarimetric, marker-controlled watershed",
author = "Juanjuan Yu and Xiufeng He and Peng Yang and Mahdi Motagh and Jia Xu and Jiacheng Xiong",
note = "Funding Information: He, X. was supported by the National Natural Science Foundation of China, grant number 41830110. Yu, J. was supported by the State Scholarship Fund from the Chinese Scholarship Council under Grant 202106710062. Xu, J. was supported by the Key Laboratory of Land Satellite Remote Sensing Application, Ministry of Natural Resources of the People{\textquoteright}s Republic of China under grant KLSMNR-K202209 and the Natural Resources Development Special Fund (Marine Science and Technology Innovation) Project of Jiangsu Province under grant JSZRHYKJ202101.",
year = "2023",
month = apr,
day = "24",
doi = "10.3390/rs15092246",
language = "English",
volume = "15",
journal = "Remote sensing",
issn = "2072-4292",
publisher = "Multidisciplinary Digital Publishing Institute",
number = "9",

}

Download

TY - JOUR

T1 - Coastal Aquaculture Extraction Using GF-3 Fully Polarimetric SAR Imagery

T2 - A Framework Integrating UNet++ with Marker-Controlled Watershed Segmentation

AU - Yu, Juanjuan

AU - He, Xiufeng

AU - Yang, Peng

AU - Motagh, Mahdi

AU - Xu, Jia

AU - Xiong, Jiacheng

N1 - Funding Information: He, X. was supported by the National Natural Science Foundation of China, grant number 41830110. Yu, J. was supported by the State Scholarship Fund from the Chinese Scholarship Council under Grant 202106710062. Xu, J. was supported by the Key Laboratory of Land Satellite Remote Sensing Application, Ministry of Natural Resources of the People’s Republic of China under grant KLSMNR-K202209 and the Natural Resources Development Special Fund (Marine Science and Technology Innovation) Project of Jiangsu Province under grant JSZRHYKJ202101.

PY - 2023/4/24

Y1 - 2023/4/24

N2 - Coastal aquaculture monitoring is vital for sustainable offshore aquaculture management. However, the dense distribution and various sizes of aquacultures make it challenging to accurately extract the boundaries of aquaculture ponds. In this study, we develop a novel combined framework that integrates UNet++ with a marker-controlled watershed segmentation strategy to facilitate aquaculture boundary extraction from fully polarimetric GaoFen-3 SAR imagery. First, four polarimetric decomposition algorithms were applied to extract 13 polarimetric scattering features. Together with the nine other polarisation and texture features, a total of 22 polarimetric features were then extracted, among which four were optimised according to the separability index. Subsequently, to reduce the “adhesion” phenomenon and separate adjacent and even adhering ponds into individual aquaculture units, two UNet++ subnetworks were utilised to construct the marker and foreground functions, the results of which were then used in the marker-controlled watershed algorithm to obtain refined aquaculture results. A multiclass segmentation strategy that divides the intermediate markers into three categories (aquaculture, background and dikes) was applied to the marker function. In addition, a boundary patch refinement postprocessing strategy was applied to the two subnetworks to extract and repair the complex/error-prone boundaries of the aquaculture ponds, followed by a morphological operation that was conducted for label augmentation. An experimental investigation performed to extract individual aquacultures in the Yancheng Coastal Wetlands indicated that the crucial features for aquacultures are Shannon entropy (SE), the intensity component of SE (SE_I) and the corresponding mean texture features (Mean_SE and Mean_SE_I). When the optimal features were introduced, our proposed method performed better than standard UNet++ in aquaculture extraction, achieving improvements of 1.8%, 3.2%, 21.7% and 12.1% in F1, IoU, MR and insF1, respectively. The experimental results indicate that the proposed method can handle the adhesion of both adjacent objects and unclear boundaries effectively and capture clear and refined aquaculture boundaries.

AB - Coastal aquaculture monitoring is vital for sustainable offshore aquaculture management. However, the dense distribution and various sizes of aquacultures make it challenging to accurately extract the boundaries of aquaculture ponds. In this study, we develop a novel combined framework that integrates UNet++ with a marker-controlled watershed segmentation strategy to facilitate aquaculture boundary extraction from fully polarimetric GaoFen-3 SAR imagery. First, four polarimetric decomposition algorithms were applied to extract 13 polarimetric scattering features. Together with the nine other polarisation and texture features, a total of 22 polarimetric features were then extracted, among which four were optimised according to the separability index. Subsequently, to reduce the “adhesion” phenomenon and separate adjacent and even adhering ponds into individual aquaculture units, two UNet++ subnetworks were utilised to construct the marker and foreground functions, the results of which were then used in the marker-controlled watershed algorithm to obtain refined aquaculture results. A multiclass segmentation strategy that divides the intermediate markers into three categories (aquaculture, background and dikes) was applied to the marker function. In addition, a boundary patch refinement postprocessing strategy was applied to the two subnetworks to extract and repair the complex/error-prone boundaries of the aquaculture ponds, followed by a morphological operation that was conducted for label augmentation. An experimental investigation performed to extract individual aquacultures in the Yancheng Coastal Wetlands indicated that the crucial features for aquacultures are Shannon entropy (SE), the intensity component of SE (SE_I) and the corresponding mean texture features (Mean_SE and Mean_SE_I). When the optimal features were introduced, our proposed method performed better than standard UNet++ in aquaculture extraction, achieving improvements of 1.8%, 3.2%, 21.7% and 12.1% in F1, IoU, MR and insF1, respectively. The experimental results indicate that the proposed method can handle the adhesion of both adjacent objects and unclear boundaries effectively and capture clear and refined aquaculture boundaries.

KW - boundary patch refinement

KW - coastal aquaculture

KW - deep learning

KW - GF-3 fully polarimetric

KW - marker-controlled watershed

UR - http://www.scopus.com/inward/record.url?scp=85159316774&partnerID=8YFLogxK

U2 - 10.3390/rs15092246

DO - 10.3390/rs15092246

M3 - Article

AN - SCOPUS:85159316774

VL - 15

JO - Remote sensing

JF - Remote sensing

SN - 2072-4292

IS - 9

M1 - 2246

ER -