ITERATIVE RE-WEIGHTED INSTANCE TRANSFER FOR DOMAIN ADAPTATION

Publikation: Beitrag in FachzeitschriftKonferenzaufsatz in FachzeitschriftForschungPeer-Review

Autoren

  • A. Paul
  • F. Rottensteiner
  • C. Heipke
Forschungs-netzwerk anzeigen

Details

OriginalspracheEnglisch
Seiten (von - bis)339-346
Seitenumfang8
FachzeitschriftISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences
Jahrgang3
Ausgabenummer3
PublikationsstatusVeröffentlicht - 6 Juni 2016
Veranstaltung23rd International Society for Photogrammetry and Remote Sensing Congress, ISPRS 2016 - Prague, Tschechische Republik
Dauer: 12 Juli 201619 Juli 2016

Abstract

Domain adaptation techniques in transfer learning try to reduce the amount of training data required for classification by adapting a classifier trained on samples from a source domain to a new data set (target domain) where the features may have different distributions. In this paper, we propose a new technique for domain adaptation based on logistic regression. Starting with a classifier trained on training data from the source domain, we iteratively include target domain samples for which class labels have been obtained from the current state of the classifier, while at the same time removing source domain samples. In each iteration the classifier is re-trained, so that the decision boundaries are slowly transferred to the distribution of the target features. To make the transfer procedure more robust we introduce weights as a function of distance from the decision boundary and a new way of regularisation. Our methodology is evaluated using a benchmark data set consisting of aerial images and digital surface models. The experimental results show that in the majority of cases our domain adaptation approach can lead to an improvement of the classification accuracy without additional training data, but also indicate remaining problems if the difference in the feature distributions becomes too large.

ASJC Scopus Sachgebiete

Zitieren

ITERATIVE RE-WEIGHTED INSTANCE TRANSFER FOR DOMAIN ADAPTATION. / Paul, A.; Rottensteiner, F.; Heipke, C.
in: ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Jahrgang 3, Nr. 3, 06.06.2016, S. 339-346.

Publikation: Beitrag in FachzeitschriftKonferenzaufsatz in FachzeitschriftForschungPeer-Review

Paul, A, Rottensteiner, F & Heipke, C 2016, 'ITERATIVE RE-WEIGHTED INSTANCE TRANSFER FOR DOMAIN ADAPTATION', ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Jg. 3, Nr. 3, S. 339-346. https://doi.org/10.5194/isprs-annals-III-3-339-2016
Paul, A., Rottensteiner, F., & Heipke, C. (2016). ITERATIVE RE-WEIGHTED INSTANCE TRANSFER FOR DOMAIN ADAPTATION. ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, 3(3), 339-346. https://doi.org/10.5194/isprs-annals-III-3-339-2016
Paul A, Rottensteiner F, Heipke C. ITERATIVE RE-WEIGHTED INSTANCE TRANSFER FOR DOMAIN ADAPTATION. ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences. 2016 Jun 6;3(3):339-346. doi: 10.5194/isprs-annals-III-3-339-2016
Paul, A. ; Rottensteiner, F. ; Heipke, C. / ITERATIVE RE-WEIGHTED INSTANCE TRANSFER FOR DOMAIN ADAPTATION. in: ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences. 2016 ; Jahrgang 3, Nr. 3. S. 339-346.
Download
@article{ef55fc399a33431eb562caab6b849c64,
title = "ITERATIVE RE-WEIGHTED INSTANCE TRANSFER FOR DOMAIN ADAPTATION",
abstract = "Domain adaptation techniques in transfer learning try to reduce the amount of training data required for classification by adapting a classifier trained on samples from a source domain to a new data set (target domain) where the features may have different distributions. In this paper, we propose a new technique for domain adaptation based on logistic regression. Starting with a classifier trained on training data from the source domain, we iteratively include target domain samples for which class labels have been obtained from the current state of the classifier, while at the same time removing source domain samples. In each iteration the classifier is re-trained, so that the decision boundaries are slowly transferred to the distribution of the target features. To make the transfer procedure more robust we introduce weights as a function of distance from the decision boundary and a new way of regularisation. Our methodology is evaluated using a benchmark data set consisting of aerial images and digital surface models. The experimental results show that in the majority of cases our domain adaptation approach can lead to an improvement of the classification accuracy without additional training data, but also indicate remaining problems if the difference in the feature distributions becomes too large.",
keywords = "Domain Adaptation, Knowledge Transfer, Logistic Regression, Machine Learning, Remote Sensing, Transfer Learning",
author = "A. Paul and F. Rottensteiner and C. Heipke",
note = "Copyright: Copyright 2019 Elsevier B.V., All rights reserved.; 23rd International Society for Photogrammetry and Remote Sensing Congress, ISPRS 2016 ; Conference date: 12-07-2016 Through 19-07-2016",
year = "2016",
month = jun,
day = "6",
doi = "10.5194/isprs-annals-III-3-339-2016",
language = "English",
volume = "3",
pages = "339--346",
number = "3",

}

Download

TY - JOUR

T1 - ITERATIVE RE-WEIGHTED INSTANCE TRANSFER FOR DOMAIN ADAPTATION

AU - Paul, A.

AU - Rottensteiner, F.

AU - Heipke, C.

N1 - Copyright: Copyright 2019 Elsevier B.V., All rights reserved.

PY - 2016/6/6

Y1 - 2016/6/6

N2 - Domain adaptation techniques in transfer learning try to reduce the amount of training data required for classification by adapting a classifier trained on samples from a source domain to a new data set (target domain) where the features may have different distributions. In this paper, we propose a new technique for domain adaptation based on logistic regression. Starting with a classifier trained on training data from the source domain, we iteratively include target domain samples for which class labels have been obtained from the current state of the classifier, while at the same time removing source domain samples. In each iteration the classifier is re-trained, so that the decision boundaries are slowly transferred to the distribution of the target features. To make the transfer procedure more robust we introduce weights as a function of distance from the decision boundary and a new way of regularisation. Our methodology is evaluated using a benchmark data set consisting of aerial images and digital surface models. The experimental results show that in the majority of cases our domain adaptation approach can lead to an improvement of the classification accuracy without additional training data, but also indicate remaining problems if the difference in the feature distributions becomes too large.

AB - Domain adaptation techniques in transfer learning try to reduce the amount of training data required for classification by adapting a classifier trained on samples from a source domain to a new data set (target domain) where the features may have different distributions. In this paper, we propose a new technique for domain adaptation based on logistic regression. Starting with a classifier trained on training data from the source domain, we iteratively include target domain samples for which class labels have been obtained from the current state of the classifier, while at the same time removing source domain samples. In each iteration the classifier is re-trained, so that the decision boundaries are slowly transferred to the distribution of the target features. To make the transfer procedure more robust we introduce weights as a function of distance from the decision boundary and a new way of regularisation. Our methodology is evaluated using a benchmark data set consisting of aerial images and digital surface models. The experimental results show that in the majority of cases our domain adaptation approach can lead to an improvement of the classification accuracy without additional training data, but also indicate remaining problems if the difference in the feature distributions becomes too large.

KW - Domain Adaptation

KW - Knowledge Transfer

KW - Logistic Regression

KW - Machine Learning

KW - Remote Sensing

KW - Transfer Learning

UR - http://www.scopus.com/inward/record.url?scp=85044544116&partnerID=8YFLogxK

U2 - 10.5194/isprs-annals-III-3-339-2016

DO - 10.5194/isprs-annals-III-3-339-2016

M3 - Conference article

AN - SCOPUS:85044544116

VL - 3

SP - 339

EP - 346

JO - ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences

JF - ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences

SN - 2194-9042

IS - 3

T2 - 23rd International Society for Photogrammetry and Remote Sensing Congress, ISPRS 2016

Y2 - 12 July 2016 through 19 July 2016

ER -