Intelligent 3D Crack Reconstruction using Close Range Photogrammetry Imagery

Research output: Contribution to journalConference articleResearchpeer review

Authors

  • Soheil Majidi
  • Mohammad Omidalizarandi
  • M.A. Sharifi

Research Organisations

External Research Organisations

  • University of Tehran
View graph of relations

Details

Original languageEnglish
Pages (from-to)443-450
Number of pages8
JournalISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences
Volume10
Issue number4/W1-2022
Publication statusPublished - 14 Jan 2023
Event6th SMPR and 4th GIResearch, ISPRS Geospatial Conference -
Duration: 19 Feb 202322 Feb 2023

Abstract

Civil infrastructure structural health monitoring (SHM) and its preservation from deterioration is a crucial task. In general, natural disasters like severe earthquakes, extreme landslides, subsidence or intensive floods directly influence the health of civil structures such as buildings, bridges, roads and dams. Evaluation and inspection of defects and damages of the aforementioned structures help to preserve them from destruction by accelerating rehabilitation and reconstruction. An automatic and precise crack detection framework is required for periodic assessment and inspection due to the large number of the structures. In this study, a two-step crack segmentation and its 3D reconstruction procedure is proposed. The crack segmentation is carried out by using Deeplabv3+ architecture and Xception as the backbone. Next, Squeeze-and-Excitation is added as an attention module to achieve higher accuracy. Integration of predicted masks and original images into a structure-from-motion procedure is additionally taken into account. In the last step, ground control points and scale bars are considered to overcome the problem of datum rank deficiency in absolute orientation through the bundle adjustment procedure in aerial triangulation. The most probable segmented cracks are overlaid on the 3D point clouds in the global coordinate system with true scale. Our network is trained based on 8000 images and their corresponding masks, leading to 69% in Intersection over Union (IoU) index. Submillimeter accuracy of crack reconstruction using the proposed methodology is validated with a scale bar.

Keywords

    Crack Segmentation, Crack 3D Reconstruction, DeepLabv3+, Xception, Structural Health Monitoring, Deep Learning, Structure From Motion, Civil Infrastructures

ASJC Scopus subject areas

Cite this

Intelligent 3D Crack Reconstruction using Close Range Photogrammetry Imagery. / Majidi, Soheil; Omidalizarandi, Mohammad; Sharifi, M.A.
In: ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Vol. 10, No. 4/W1-2022, 14.01.2023, p. 443-450.

Research output: Contribution to journalConference articleResearchpeer review

Majidi, S, Omidalizarandi, M & Sharifi, MA 2023, 'Intelligent 3D Crack Reconstruction using Close Range Photogrammetry Imagery', ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, vol. 10, no. 4/W1-2022, pp. 443-450. https://doi.org/10.5194/isprs-annals-X-4-W1-2022-443-2023
Majidi, S., Omidalizarandi, M., & Sharifi, M. A. (2023). Intelligent 3D Crack Reconstruction using Close Range Photogrammetry Imagery. ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, 10(4/W1-2022), 443-450. https://doi.org/10.5194/isprs-annals-X-4-W1-2022-443-2023
Majidi S, Omidalizarandi M, Sharifi MA. Intelligent 3D Crack Reconstruction using Close Range Photogrammetry Imagery. ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences. 2023 Jan 14;10(4/W1-2022):443-450. doi: 10.5194/isprs-annals-X-4-W1-2022-443-2023
Majidi, Soheil ; Omidalizarandi, Mohammad ; Sharifi, M.A. / Intelligent 3D Crack Reconstruction using Close Range Photogrammetry Imagery. In: ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences. 2023 ; Vol. 10, No. 4/W1-2022. pp. 443-450.
Download
@article{ac9d5db0e59748ac8e66f4fbccfc8e59,
title = "Intelligent 3D Crack Reconstruction using Close Range Photogrammetry Imagery",
abstract = "Civil infrastructure structural health monitoring (SHM) and its preservation from deterioration is a crucial task. In general, natural disasters like severe earthquakes, extreme landslides, subsidence or intensive floods directly influence the health of civil structures such as buildings, bridges, roads and dams. Evaluation and inspection of defects and damages of the aforementioned structures help to preserve them from destruction by accelerating rehabilitation and reconstruction. An automatic and precise crack detection framework is required for periodic assessment and inspection due to the large number of the structures. In this study, a two-step crack segmentation and its 3D reconstruction procedure is proposed. The crack segmentation is carried out by using Deeplabv3+ architecture and Xception as the backbone. Next, Squeeze-and-Excitation is added as an attention module to achieve higher accuracy. Integration of predicted masks and original images into a structure-from-motion procedure is additionally taken into account. In the last step, ground control points and scale bars are considered to overcome the problem of datum rank deficiency in absolute orientation through the bundle adjustment procedure in aerial triangulation. The most probable segmented cracks are overlaid on the 3D point clouds in the global coordinate system with true scale. Our network is trained based on 8000 images and their corresponding masks, leading to 69% in Intersection over Union (IoU) index. Submillimeter accuracy of crack reconstruction using the proposed methodology is validated with a scale bar.",
keywords = "Crack Segmentation, Crack 3D Reconstruction, DeepLabv3+, Xception, Structural Health Monitoring, Deep Learning, Structure From Motion, Civil Infrastructures",
author = "Soheil Majidi and Mohammad Omidalizarandi and M.A. Sharifi",
year = "2023",
month = jan,
day = "14",
doi = "10.5194/isprs-annals-X-4-W1-2022-443-2023",
language = "English",
volume = "10",
pages = "443--450",
number = "4/W1-2022",
note = "6th SMPR and 4th GIResearch, ISPRS Geospatial Conference ; Conference date: 19-02-2023 Through 22-02-2023",

}

Download

TY - JOUR

T1 - Intelligent 3D Crack Reconstruction using Close Range Photogrammetry Imagery

AU - Majidi, Soheil

AU - Omidalizarandi, Mohammad

AU - Sharifi, M.A.

PY - 2023/1/14

Y1 - 2023/1/14

N2 - Civil infrastructure structural health monitoring (SHM) and its preservation from deterioration is a crucial task. In general, natural disasters like severe earthquakes, extreme landslides, subsidence or intensive floods directly influence the health of civil structures such as buildings, bridges, roads and dams. Evaluation and inspection of defects and damages of the aforementioned structures help to preserve them from destruction by accelerating rehabilitation and reconstruction. An automatic and precise crack detection framework is required for periodic assessment and inspection due to the large number of the structures. In this study, a two-step crack segmentation and its 3D reconstruction procedure is proposed. The crack segmentation is carried out by using Deeplabv3+ architecture and Xception as the backbone. Next, Squeeze-and-Excitation is added as an attention module to achieve higher accuracy. Integration of predicted masks and original images into a structure-from-motion procedure is additionally taken into account. In the last step, ground control points and scale bars are considered to overcome the problem of datum rank deficiency in absolute orientation through the bundle adjustment procedure in aerial triangulation. The most probable segmented cracks are overlaid on the 3D point clouds in the global coordinate system with true scale. Our network is trained based on 8000 images and their corresponding masks, leading to 69% in Intersection over Union (IoU) index. Submillimeter accuracy of crack reconstruction using the proposed methodology is validated with a scale bar.

AB - Civil infrastructure structural health monitoring (SHM) and its preservation from deterioration is a crucial task. In general, natural disasters like severe earthquakes, extreme landslides, subsidence or intensive floods directly influence the health of civil structures such as buildings, bridges, roads and dams. Evaluation and inspection of defects and damages of the aforementioned structures help to preserve them from destruction by accelerating rehabilitation and reconstruction. An automatic and precise crack detection framework is required for periodic assessment and inspection due to the large number of the structures. In this study, a two-step crack segmentation and its 3D reconstruction procedure is proposed. The crack segmentation is carried out by using Deeplabv3+ architecture and Xception as the backbone. Next, Squeeze-and-Excitation is added as an attention module to achieve higher accuracy. Integration of predicted masks and original images into a structure-from-motion procedure is additionally taken into account. In the last step, ground control points and scale bars are considered to overcome the problem of datum rank deficiency in absolute orientation through the bundle adjustment procedure in aerial triangulation. The most probable segmented cracks are overlaid on the 3D point clouds in the global coordinate system with true scale. Our network is trained based on 8000 images and their corresponding masks, leading to 69% in Intersection over Union (IoU) index. Submillimeter accuracy of crack reconstruction using the proposed methodology is validated with a scale bar.

KW - Crack Segmentation

KW - Crack 3D Reconstruction

KW - DeepLabv3+

KW - Xception

KW - Structural Health Monitoring

KW - Deep Learning

KW - Structure From Motion

KW - Civil Infrastructures

UR - http://www.scopus.com/inward/record.url?scp=85146923387&partnerID=8YFLogxK

U2 - 10.5194/isprs-annals-X-4-W1-2022-443-2023

DO - 10.5194/isprs-annals-X-4-W1-2022-443-2023

M3 - Conference article

VL - 10

SP - 443

EP - 450

JO - ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences

JF - ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences

SN - 2194-9042

IS - 4/W1-2022

T2 - 6th SMPR and 4th GIResearch, ISPRS Geospatial Conference

Y2 - 19 February 2023 through 22 February 2023

ER -