Feature descriptor by convolution and pooling autoencoders

Publikation: Beitrag in FachzeitschriftKonferenzaufsatz in FachzeitschriftForschungPeer-Review

Autorschaft

  • L. Chen
  • F. Rottensteiner
  • C. Heipke
Forschungs-netzwerk anzeigen

Details

OriginalspracheEnglisch
Seiten (von - bis)31-38
Seitenumfang8
FachzeitschriftInternational Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences - ISPRS Archives
Jahrgang40
Ausgabenummer3W2
PublikationsstatusVeröffentlicht - 10 März 2015
VeranstaltungJoint ISPRS Conference on Photogrammetric Image Analysis, PIA 2015 and High Resolution Earth Imaging for Geospatial Information, HRIGI 2015 - Munich, Deutschland
Dauer: 25 März 201527 März 2015

Abstract

In this paper we present several descriptors for feature-based matching based on autoencoders, and we evaluate the performance of these descriptors. In a training phase, we learn autoencoders from image patches extracted in local windows surrounding key points determined by the Difference of Gaussian extractor. In the matching phase, we construct key point descriptors based on the learned autoencoders, and we use these descriptors as the basis for local keypoint descriptor matching. Three types of descriptors based on autoencoders are presented. To evaluate the performance of these descriptors, recall and 1-precision curves are generated for different kinds of transformations, e.g. zoom and rotation, viewpoint change, using a standard benchmark data set. We compare the performance of these descriptors with the one achieved for SIFT. Early results presented in this paper show that, whereas SIFT in general performs better than the new descriptors, the descriptors based on autoencoders show some potential for feature based matching.

ASJC Scopus Sachgebiete

Zitieren

Feature descriptor by convolution and pooling autoencoders. / Chen, L.; Rottensteiner, F.; Heipke, C.
in: International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences - ISPRS Archives, Jahrgang 40, Nr. 3W2, 10.03.2015, S. 31-38.

Publikation: Beitrag in FachzeitschriftKonferenzaufsatz in FachzeitschriftForschungPeer-Review

Chen, L, Rottensteiner, F & Heipke, C 2015, 'Feature descriptor by convolution and pooling autoencoders', International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences - ISPRS Archives, Jg. 40, Nr. 3W2, S. 31-38. https://doi.org/10.5194/isprsarchives-XL-3-W2-31-2015
Chen, L., Rottensteiner, F., & Heipke, C. (2015). Feature descriptor by convolution and pooling autoencoders. International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences - ISPRS Archives, 40(3W2), 31-38. https://doi.org/10.5194/isprsarchives-XL-3-W2-31-2015
Chen L, Rottensteiner F, Heipke C. Feature descriptor by convolution and pooling autoencoders. International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences - ISPRS Archives. 2015 Mär 10;40(3W2):31-38. doi: 10.5194/isprsarchives-XL-3-W2-31-2015
Chen, L. ; Rottensteiner, F. ; Heipke, C. / Feature descriptor by convolution and pooling autoencoders. in: International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences - ISPRS Archives. 2015 ; Jahrgang 40, Nr. 3W2. S. 31-38.
Download
@article{cd66589fac12464cbaafd0837d787cc6,
title = "Feature descriptor by convolution and pooling autoencoders",
abstract = "In this paper we present several descriptors for feature-based matching based on autoencoders, and we evaluate the performance of these descriptors. In a training phase, we learn autoencoders from image patches extracted in local windows surrounding key points determined by the Difference of Gaussian extractor. In the matching phase, we construct key point descriptors based on the learned autoencoders, and we use these descriptors as the basis for local keypoint descriptor matching. Three types of descriptors based on autoencoders are presented. To evaluate the performance of these descriptors, recall and 1-precision curves are generated for different kinds of transformations, e.g. zoom and rotation, viewpoint change, using a standard benchmark data set. We compare the performance of these descriptors with the one achieved for SIFT. Early results presented in this paper show that, whereas SIFT in general performs better than the new descriptors, the descriptors based on autoencoders show some potential for feature based matching.",
keywords = "Autoencoder, Descriptor evaluation, Image matching, Learning descriptor, Pooling, Representation learning",
author = "L. Chen and F. Rottensteiner and C. Heipke",
year = "2015",
month = mar,
day = "10",
doi = "10.5194/isprsarchives-XL-3-W2-31-2015",
language = "English",
volume = "40",
pages = "31--38",
number = "3W2",
note = "Joint ISPRS Conference on Photogrammetric Image Analysis, PIA 2015 and High Resolution Earth Imaging for Geospatial Information, HRIGI 2015 ; Conference date: 25-03-2015 Through 27-03-2015",

}

Download

TY - JOUR

T1 - Feature descriptor by convolution and pooling autoencoders

AU - Chen, L.

AU - Rottensteiner, F.

AU - Heipke, C.

PY - 2015/3/10

Y1 - 2015/3/10

N2 - In this paper we present several descriptors for feature-based matching based on autoencoders, and we evaluate the performance of these descriptors. In a training phase, we learn autoencoders from image patches extracted in local windows surrounding key points determined by the Difference of Gaussian extractor. In the matching phase, we construct key point descriptors based on the learned autoencoders, and we use these descriptors as the basis for local keypoint descriptor matching. Three types of descriptors based on autoencoders are presented. To evaluate the performance of these descriptors, recall and 1-precision curves are generated for different kinds of transformations, e.g. zoom and rotation, viewpoint change, using a standard benchmark data set. We compare the performance of these descriptors with the one achieved for SIFT. Early results presented in this paper show that, whereas SIFT in general performs better than the new descriptors, the descriptors based on autoencoders show some potential for feature based matching.

AB - In this paper we present several descriptors for feature-based matching based on autoencoders, and we evaluate the performance of these descriptors. In a training phase, we learn autoencoders from image patches extracted in local windows surrounding key points determined by the Difference of Gaussian extractor. In the matching phase, we construct key point descriptors based on the learned autoencoders, and we use these descriptors as the basis for local keypoint descriptor matching. Three types of descriptors based on autoencoders are presented. To evaluate the performance of these descriptors, recall and 1-precision curves are generated for different kinds of transformations, e.g. zoom and rotation, viewpoint change, using a standard benchmark data set. We compare the performance of these descriptors with the one achieved for SIFT. Early results presented in this paper show that, whereas SIFT in general performs better than the new descriptors, the descriptors based on autoencoders show some potential for feature based matching.

KW - Autoencoder

KW - Descriptor evaluation

KW - Image matching

KW - Learning descriptor

KW - Pooling

KW - Representation learning

UR - http://www.scopus.com/inward/record.url?scp=84925366146&partnerID=8YFLogxK

U2 - 10.5194/isprsarchives-XL-3-W2-31-2015

DO - 10.5194/isprsarchives-XL-3-W2-31-2015

M3 - Conference article

AN - SCOPUS:84925366146

VL - 40

SP - 31

EP - 38

JO - International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences - ISPRS Archives

JF - International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences - ISPRS Archives

SN - 1682-1750

IS - 3W2

T2 - Joint ISPRS Conference on Photogrammetric Image Analysis, PIA 2015 and High Resolution Earth Imaging for Geospatial Information, HRIGI 2015

Y2 - 25 March 2015 through 27 March 2015

ER -