Details
| Original language | English |
|---|---|
| Publication status | Published - 11 Aug 2023 |
| Event | SPIE Optical Metrology, 2023, Munich, Germany - München, München, Germany Duration: 26 Jun 2023 → 30 Jun 2023 Conference number: 1262309 |
Conference
| Conference | SPIE Optical Metrology, 2023, Munich, Germany |
|---|---|
| Country/Territory | Germany |
| City | München |
| Period | 26 Jun 2023 → 30 Jun 2023 |
Abstract
Keywords
- CNN, damage inspection, endoscopic inspection, ensemble learning, meta-learner, semantic segmentation
ASJC Scopus subject areas
- Materials Science(all)
- Electronic, Optical and Magnetic Materials
- Physics and Astronomy(all)
- Condensed Matter Physics
- Mathematics(all)
- Applied Mathematics
- Engineering(all)
- Electrical and Electronic Engineering
- Computer Science(all)
- Computer Science Applications
Cite this
- Standard
- Harvard
- Apa
- Vancouver
- BibTeX
- RIS
2023. Abstract from SPIE Optical Metrology, 2023, Munich, Germany, München, Germany.
Research output: Contribution to conference › Abstract › Research
}
TY - CONF
T1 - Improved segmentation of damages on high-resolution coating images using CNN-based ensemble learning
AU - Hedrich, Kolja
AU - Hinz, Lennart
AU - Reithmeier, Eduard
N1 - Conference code: 1262309
PY - 2023/8/11
Y1 - 2023/8/11
N2 - The automation of inspection processes in aircraft engines comprises challenging computer vision tasks. In particular, the inspection of coating damages in confined spaces with hand-held endoscopes is based on image data acquired under dynamic operating conditions (illumination, position and orientation of the sensor, etc.). In this study, 2D RGB video data is processed to quantify damages in large coating areas. Therefore, the video frames are pre-processed by feature tracking and stitching algorithms to generate high-resolution overview images. For the subsequent analysis of the whole coating area and to overcome the challenges posed by the diverse image data, Convolutional Neural Networks (CNNs) are applied. In a preliminary study, it was found that the image analysis is advantageous when executed on different scales. Here, one CNN is applied on small image patches without down-scaling, while a second CNN is applied on larger down-scaled image patches. This multi-scale approach raises the challenge to combine the predictions of both networks. Therefore, this study presents a novel method to increase the segmentation accuracy by interpreting the network results to derive a final segmentation mask. This ensemble method consists of a CNN, which is applied on the predictions of the given patches from the overview images. The evaluation of this method comprises different pre-processing techniques regarding the logit outputs of the preceding networks as well as additional information such as RGB image data. Further, different network structures are evaluated, which include own structures specifically designed for this task. Finally, these approaches are compared against state-of-the-art network structures.
AB - The automation of inspection processes in aircraft engines comprises challenging computer vision tasks. In particular, the inspection of coating damages in confined spaces with hand-held endoscopes is based on image data acquired under dynamic operating conditions (illumination, position and orientation of the sensor, etc.). In this study, 2D RGB video data is processed to quantify damages in large coating areas. Therefore, the video frames are pre-processed by feature tracking and stitching algorithms to generate high-resolution overview images. For the subsequent analysis of the whole coating area and to overcome the challenges posed by the diverse image data, Convolutional Neural Networks (CNNs) are applied. In a preliminary study, it was found that the image analysis is advantageous when executed on different scales. Here, one CNN is applied on small image patches without down-scaling, while a second CNN is applied on larger down-scaled image patches. This multi-scale approach raises the challenge to combine the predictions of both networks. Therefore, this study presents a novel method to increase the segmentation accuracy by interpreting the network results to derive a final segmentation mask. This ensemble method consists of a CNN, which is applied on the predictions of the given patches from the overview images. The evaluation of this method comprises different pre-processing techniques regarding the logit outputs of the preceding networks as well as additional information such as RGB image data. Further, different network structures are evaluated, which include own structures specifically designed for this task. Finally, these approaches are compared against state-of-the-art network structures.
KW - CNN
KW - damage inspection
KW - endoscopic inspection
KW - ensemble learning
KW - meta-learner
KW - semantic segmentation
UR - http://www.scopus.com/inward/record.url?scp=85173511934&partnerID=8YFLogxK
U2 - 10.1117/12.2673821
DO - 10.1117/12.2673821
M3 - Abstract
T2 - SPIE Optical Metrology, 2023, Munich, Germany
Y2 - 26 June 2023 through 30 June 2023
ER -