Bedoi: Benchmarks For Determining Overlapping Images With Photogrammetric Information

Research output: Contribution to journalConference articleResearchpeer review

Authors

  • H. Zhan
  • Y. F. Yu
  • Q. B. Hou
  • R. Xia
  • Y. Feng
  • Z. Q. Zhan
  • R. Hänsch
  • C. Heipke
  • Michael Gruber
  • Y.W. Xu
  • Xin Wang
  • M.L. Li

External Research Organisations

  • Wuhan University
  • Technical University of Munich (TUM)
  • German Aerospace Center (DLR)
  • Vexcel Imaging GmbH
  • Nanjing University of Aeronautics and Astronautics
View graph of relations

Details

Original languageEnglish
Pages (from-to)1685-1692
Number of pages8
JournalInternational Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences - ISPRS Archives
VolumeXLVIII-1
Issue numberW2-2023
Publication statusPublished - 14 Dec 2023
EventISPRS Geospatial Week 2023 - Kairo, Egypt
Duration: 2 Sept 20237 Sept 2023

Abstract

For conventional SfM pipeline, image matching is enduring limitation when considering the time efficiency. In the last few years, to speed up image matching procedure, many image retrieval works were proposed to fast find overlapping image pairs, e.g., bag-of-word that clusters hand-crafted local features in a hierarchical way for efficient similar image retrieval, or learning-based global features (such as, VGG or ResNet) are used to represent image in a global compact manner. However, there are rarely benchmarks with referenced overlapping information to: first, evaluate the retrieval performance; second, fine tune deep-learning models along the direction that is more capable to deal with overlapping image pairs. In this work, based on traditional photogrammetric procedures, relevant photogrammetric information is obtained including image orientation parameters, 3D mesh model and etc., we then generate a benchmark for determining Overlapping Images - BeDOI, in which referenced pairwise overlapping relationships are estimated via rigorous photogrammetric geometry. To extend the generality, in total, BeDOI contains 13667 images which are basically UAV and close-range images of various scene categories, e.g., urban cities, campus, village, historical relics, green land, buildings and etc.

Keywords

    Image Matching, Image Retrieval, Overlapping image pairs, Photogrammetric Information, Structure from Motion (SfM)

ASJC Scopus subject areas

Cite this

Bedoi: Benchmarks For Determining Overlapping Images With Photogrammetric Information . / Zhan, H.; Yu, Y. F.; Hou, Q. B. et al.
In: International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences - ISPRS Archives, Vol. XLVIII-1, No. W2-2023, 14.12.2023, p. 1685-1692.

Research output: Contribution to journalConference articleResearchpeer review

Zhan, H, Yu, YF, Hou, QB, Xia, R, Feng, Y, Zhan, ZQ, Hänsch, R, Heipke, C, Gruber, M, Xu, YW, Wang, X & Li, ML 2023, 'Bedoi: Benchmarks For Determining Overlapping Images With Photogrammetric Information ', International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences - ISPRS Archives, vol. XLVIII-1, no. W2-2023, pp. 1685-1692. https://doi.org/10.5194/isprs-archives-XLVIII-1-W2-2023-1685-2023
Zhan, H., Yu, Y. F., Hou, Q. B., Xia, R., Feng, Y., Zhan, Z. Q., Hänsch, R., Heipke, C., Gruber, M., Xu, Y. W., Wang, X., & Li, M. L. (2023). Bedoi: Benchmarks For Determining Overlapping Images With Photogrammetric Information . International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences - ISPRS Archives, XLVIII-1(W2-2023), 1685-1692. https://doi.org/10.5194/isprs-archives-XLVIII-1-W2-2023-1685-2023
Zhan H, Yu YF, Hou QB, Xia R, Feng Y, Zhan ZQ et al. Bedoi: Benchmarks For Determining Overlapping Images With Photogrammetric Information . International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences - ISPRS Archives. 2023 Dec 14;XLVIII-1(W2-2023):1685-1692. doi: 10.5194/isprs-archives-XLVIII-1-W2-2023-1685-2023
Zhan, H. ; Yu, Y. F. ; Hou, Q. B. et al. / Bedoi : Benchmarks For Determining Overlapping Images With Photogrammetric Information . In: International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences - ISPRS Archives. 2023 ; Vol. XLVIII-1, No. W2-2023. pp. 1685-1692.
Download
@article{6f38e3ad0b6f4c3ca8dd3a8436a00e37,
title = "Bedoi: Benchmarks For Determining Overlapping Images With Photogrammetric Information ",
abstract = "For conventional SfM pipeline, image matching is enduring limitation when considering the time efficiency. In the last few years, to speed up image matching procedure, many image retrieval works were proposed to fast find overlapping image pairs, e.g., bag-of-word that clusters hand-crafted local features in a hierarchical way for efficient similar image retrieval, or learning-based global features (such as, VGG or ResNet) are used to represent image in a global compact manner. However, there are rarely benchmarks with referenced overlapping information to: first, evaluate the retrieval performance; second, fine tune deep-learning models along the direction that is more capable to deal with overlapping image pairs. In this work, based on traditional photogrammetric procedures, relevant photogrammetric information is obtained including image orientation parameters, 3D mesh model and etc., we then generate a benchmark for determining Overlapping Images - BeDOI, in which referenced pairwise overlapping relationships are estimated via rigorous photogrammetric geometry. To extend the generality, in total, BeDOI contains 13667 images which are basically UAV and close-range images of various scene categories, e.g., urban cities, campus, village, historical relics, green land, buildings and etc.",
keywords = "Image Matching, Image Retrieval, Overlapping image pairs, Photogrammetric Information, Structure from Motion (SfM)",
author = "H. Zhan and Yu, {Y. F.} and Hou, {Q. B.} and R. Xia and Y. Feng and Zhan, {Z. Q.} and R. H{\"a}nsch and C. Heipke and Michael Gruber and Y.W. Xu and Xin Wang and M.L. Li",
note = "Funding Information: This work was supported by ISPRS Scientific Initiatives 2023, Natural Science Foundation of Hubei Province, China (No. 2022CFB727) and National Natural Science Foundation of China (No. 61871295). ; ISPRS Geospatial Week 2023 ; Conference date: 02-09-2023 Through 07-09-2023",
year = "2023",
month = dec,
day = "14",
doi = "10.5194/isprs-archives-XLVIII-1-W2-2023-1685-2023",
language = "English",
volume = "XLVIII-1",
pages = "1685--1692",
number = "W2-2023",

}

Download

TY - JOUR

T1 - Bedoi

T2 - ISPRS Geospatial Week 2023

AU - Zhan, H.

AU - Yu, Y. F.

AU - Hou, Q. B.

AU - Xia, R.

AU - Feng, Y.

AU - Zhan, Z. Q.

AU - Hänsch, R.

AU - Heipke, C.

AU - Gruber, Michael

AU - Xu, Y.W.

AU - Wang, Xin

AU - Li, M.L.

N1 - Funding Information: This work was supported by ISPRS Scientific Initiatives 2023, Natural Science Foundation of Hubei Province, China (No. 2022CFB727) and National Natural Science Foundation of China (No. 61871295).

PY - 2023/12/14

Y1 - 2023/12/14

N2 - For conventional SfM pipeline, image matching is enduring limitation when considering the time efficiency. In the last few years, to speed up image matching procedure, many image retrieval works were proposed to fast find overlapping image pairs, e.g., bag-of-word that clusters hand-crafted local features in a hierarchical way for efficient similar image retrieval, or learning-based global features (such as, VGG or ResNet) are used to represent image in a global compact manner. However, there are rarely benchmarks with referenced overlapping information to: first, evaluate the retrieval performance; second, fine tune deep-learning models along the direction that is more capable to deal with overlapping image pairs. In this work, based on traditional photogrammetric procedures, relevant photogrammetric information is obtained including image orientation parameters, 3D mesh model and etc., we then generate a benchmark for determining Overlapping Images - BeDOI, in which referenced pairwise overlapping relationships are estimated via rigorous photogrammetric geometry. To extend the generality, in total, BeDOI contains 13667 images which are basically UAV and close-range images of various scene categories, e.g., urban cities, campus, village, historical relics, green land, buildings and etc.

AB - For conventional SfM pipeline, image matching is enduring limitation when considering the time efficiency. In the last few years, to speed up image matching procedure, many image retrieval works were proposed to fast find overlapping image pairs, e.g., bag-of-word that clusters hand-crafted local features in a hierarchical way for efficient similar image retrieval, or learning-based global features (such as, VGG or ResNet) are used to represent image in a global compact manner. However, there are rarely benchmarks with referenced overlapping information to: first, evaluate the retrieval performance; second, fine tune deep-learning models along the direction that is more capable to deal with overlapping image pairs. In this work, based on traditional photogrammetric procedures, relevant photogrammetric information is obtained including image orientation parameters, 3D mesh model and etc., we then generate a benchmark for determining Overlapping Images - BeDOI, in which referenced pairwise overlapping relationships are estimated via rigorous photogrammetric geometry. To extend the generality, in total, BeDOI contains 13667 images which are basically UAV and close-range images of various scene categories, e.g., urban cities, campus, village, historical relics, green land, buildings and etc.

KW - Image Matching

KW - Image Retrieval

KW - Overlapping image pairs

KW - Photogrammetric Information

KW - Structure from Motion (SfM)

UR - http://www.scopus.com/inward/record.url?scp=85183290467&partnerID=8YFLogxK

U2 - 10.5194/isprs-archives-XLVIII-1-W2-2023-1685-2023

DO - 10.5194/isprs-archives-XLVIII-1-W2-2023-1685-2023

M3 - Conference article

AN - SCOPUS:85183290467

VL - XLVIII-1

SP - 1685

EP - 1692

JO - International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences - ISPRS Archives

JF - International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences - ISPRS Archives

SN - 1682-1750

IS - W2-2023

Y2 - 2 September 2023 through 7 September 2023

ER -