Self-Supervised Learning for Semantic Segmentation of Archaeological Monuments in DTMs

Research output: Contribution to journalArticleResearchpeer review

Authors

External Research Organisations

  • Forschungszentrum Jülich
View graph of relations

Details

Original languageEnglish
Pages (from-to)155-173
Number of pages19
JournalJournal of Computer Applications in Archaeology
Volume6
Issue number1
Early online date23 Nov 2023
Publication statusPublished - 2023

Abstract

Deep learning models need a lot of labeled data to work well. In this study, we use a Self-Supervised Learning (SSL) method for semantic segmentation of archaeological monuments in Digital Terrain Models (DTMs). This method first uses unlabeled data to pretrain a model (pretext task), and then fine-tunes it with a small labeled dataset (downstream task). We use unlabeled DTMs and Relief Visualizations (RVs) to train an encoder-decoder and a Generative Adversarial Network (GAN) in the pretext task and an annotated DTM dataset to fine-tune a semantic segmentation model in the downstream task. Experiments indicate that this approach produces better results than training from scratch or using models pretrained on image data like ImageNet. The code and pretrained weights for the encoder-decoder and the GAN models are made available on Github.1

Keywords

    Archaeology, Convolutional Neural Networks, Deep Learning, Digital Terrain Models, Generative Adversarial Networks, Relief Visualization, Self-Supervised Learning

ASJC Scopus subject areas

Cite this

Self-Supervised Learning for Semantic Segmentation of Archaeological Monuments in DTMs. / Kazimi, Bashir; Sester, Monika.
In: Journal of Computer Applications in Archaeology, Vol. 6, No. 1, 2023, p. 155-173.

Research output: Contribution to journalArticleResearchpeer review

Kazimi, B & Sester, M 2023, 'Self-Supervised Learning for Semantic Segmentation of Archaeological Monuments in DTMs', Journal of Computer Applications in Archaeology, vol. 6, no. 1, pp. 155-173. https://doi.org/10.5334/jcaa.110
Kazimi B, Sester M. Self-Supervised Learning for Semantic Segmentation of Archaeological Monuments in DTMs. Journal of Computer Applications in Archaeology. 2023;6(1):155-173. Epub 2023 Nov 23. doi: 10.5334/jcaa.110
Kazimi, Bashir ; Sester, Monika. / Self-Supervised Learning for Semantic Segmentation of Archaeological Monuments in DTMs. In: Journal of Computer Applications in Archaeology. 2023 ; Vol. 6, No. 1. pp. 155-173.
Download
@article{ba0b3afee9aa426f8a167ff1d2bc4e33,
title = "Self-Supervised Learning for Semantic Segmentation of Archaeological Monuments in DTMs",
abstract = "Deep learning models need a lot of labeled data to work well. In this study, we use a Self-Supervised Learning (SSL) method for semantic segmentation of archaeological monuments in Digital Terrain Models (DTMs). This method first uses unlabeled data to pretrain a model (pretext task), and then fine-tunes it with a small labeled dataset (downstream task). We use unlabeled DTMs and Relief Visualizations (RVs) to train an encoder-decoder and a Generative Adversarial Network (GAN) in the pretext task and an annotated DTM dataset to fine-tune a semantic segmentation model in the downstream task. Experiments indicate that this approach produces better results than training from scratch or using models pretrained on image data like ImageNet. The code and pretrained weights for the encoder-decoder and the GAN models are made available on Github.1",
keywords = "Archaeology, Convolutional Neural Networks, Deep Learning, Digital Terrain Models, Generative Adversarial Networks, Relief Visualization, Self-Supervised Learning",
author = "Bashir Kazimi and Monika Sester",
note = "Funding Information: This research was funded by the Lower Saxony Ministry of Science and Culture through the “Nieders{\"a}chsisches Vorab” funding initiative and with the collaboration of Lower Saxony State Office for Heritage (Nieders{\"a}chsisches Landesamt f{\"u}r Denkmalpflege). The publication of this article was funded by the Open Access Fund of the Leibniz Universit{\"a}t Hannover.",
year = "2023",
doi = "10.5334/jcaa.110",
language = "English",
volume = "6",
pages = "155--173",
number = "1",

}

Download

TY - JOUR

T1 - Self-Supervised Learning for Semantic Segmentation of Archaeological Monuments in DTMs

AU - Kazimi, Bashir

AU - Sester, Monika

N1 - Funding Information: This research was funded by the Lower Saxony Ministry of Science and Culture through the “Niedersächsisches Vorab” funding initiative and with the collaboration of Lower Saxony State Office for Heritage (Niedersächsisches Landesamt für Denkmalpflege). The publication of this article was funded by the Open Access Fund of the Leibniz Universität Hannover.

PY - 2023

Y1 - 2023

N2 - Deep learning models need a lot of labeled data to work well. In this study, we use a Self-Supervised Learning (SSL) method for semantic segmentation of archaeological monuments in Digital Terrain Models (DTMs). This method first uses unlabeled data to pretrain a model (pretext task), and then fine-tunes it with a small labeled dataset (downstream task). We use unlabeled DTMs and Relief Visualizations (RVs) to train an encoder-decoder and a Generative Adversarial Network (GAN) in the pretext task and an annotated DTM dataset to fine-tune a semantic segmentation model in the downstream task. Experiments indicate that this approach produces better results than training from scratch or using models pretrained on image data like ImageNet. The code and pretrained weights for the encoder-decoder and the GAN models are made available on Github.1

AB - Deep learning models need a lot of labeled data to work well. In this study, we use a Self-Supervised Learning (SSL) method for semantic segmentation of archaeological monuments in Digital Terrain Models (DTMs). This method first uses unlabeled data to pretrain a model (pretext task), and then fine-tunes it with a small labeled dataset (downstream task). We use unlabeled DTMs and Relief Visualizations (RVs) to train an encoder-decoder and a Generative Adversarial Network (GAN) in the pretext task and an annotated DTM dataset to fine-tune a semantic segmentation model in the downstream task. Experiments indicate that this approach produces better results than training from scratch or using models pretrained on image data like ImageNet. The code and pretrained weights for the encoder-decoder and the GAN models are made available on Github.1

KW - Archaeology

KW - Convolutional Neural Networks

KW - Deep Learning

KW - Digital Terrain Models

KW - Generative Adversarial Networks

KW - Relief Visualization

KW - Self-Supervised Learning

UR - http://www.scopus.com/inward/record.url?scp=85179966569&partnerID=8YFLogxK

U2 - 10.5334/jcaa.110

DO - 10.5334/jcaa.110

M3 - Article

AN - SCOPUS:85179966569

VL - 6

SP - 155

EP - 173

JO - Journal of Computer Applications in Archaeology

JF - Journal of Computer Applications in Archaeology

IS - 1

ER -

By the same author(s)