Robust direct vision-based pose tracking using normalized mutual information

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Authors

View graph of relations

Details

Original languageEnglish
Title of host publicationOptical Metrology and Inspection for Industrial Applications V
EditorsToru Yoshizawa, Song Zhang, Sen Han, Sen Han
PublisherSPIE
Number of pages13
ISBN (electronic)9781510622364
Publication statusPublished - 2 Nov 2018
EventOptical Metrology and Inspection for Industrial Applications V 2018 - Beijing, China
Duration: 11 Oct 201813 Oct 2018

Publication series

NameProceedings of SPIE - The International Society for Optical Engineering
Volume10819
ISSN (Print)0277-786X
ISSN (electronic)1996-756X

Abstract

This paper presents a novel visual tracking approach that combines the NMI metric and the traditional SSD metric within a gradient-based optimization frame, which can be used for direct visual odometry and SLAM. We firstly derivate the closed form expression for first- and second-order analytical NMI derivatives under the assumption of rigid-body transformations, which then can be used by subsequent Newton-like optimization methods. Then we develop a robust tracking scheme that utilizes the robustness of NMI metric while keeping the optimization characteristics of SSD-based Lucas-Kanade (LK) tracking methods. To validate the robustness and accuracy of the proposed approach, several experiments are performed on synthetic datasets as well as real image datasets. The experimental results demonstrate that our approach can provide fast, accurate pose estimation and obtain better tracking performance over standard SSD-based methods in most cases.

Keywords

    Direct visual tracking, Nonlinear optimization, Normalized mutual information, Sum of squared differences

ASJC Scopus subject areas

Cite this

Robust direct vision-based pose tracking using normalized mutual information. / Luo, Hang; Pape, Christian; Reithmeier, Eduard.
Optical Metrology and Inspection for Industrial Applications V. ed. / Toru Yoshizawa; Song Zhang; Sen Han; Sen Han. SPIE, 2018. 108190T (Proceedings of SPIE - The International Society for Optical Engineering; Vol. 10819).

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Luo, H, Pape, C & Reithmeier, E 2018, Robust direct vision-based pose tracking using normalized mutual information. in T Yoshizawa, S Zhang, S Han & S Han (eds), Optical Metrology and Inspection for Industrial Applications V., 108190T, Proceedings of SPIE - The International Society for Optical Engineering, vol. 10819, SPIE, Optical Metrology and Inspection for Industrial Applications V 2018, Beijing, China, 11 Oct 2018. https://doi.org/10.1117/12.2500857, https://doi.org/10.15488/10272
Luo, H., Pape, C., & Reithmeier, E. (2018). Robust direct vision-based pose tracking using normalized mutual information. In T. Yoshizawa, S. Zhang, S. Han, & S. Han (Eds.), Optical Metrology and Inspection for Industrial Applications V Article 108190T (Proceedings of SPIE - The International Society for Optical Engineering; Vol. 10819). SPIE. https://doi.org/10.1117/12.2500857, https://doi.org/10.15488/10272
Luo H, Pape C, Reithmeier E. Robust direct vision-based pose tracking using normalized mutual information. In Yoshizawa T, Zhang S, Han S, Han S, editors, Optical Metrology and Inspection for Industrial Applications V. SPIE. 2018. 108190T. (Proceedings of SPIE - The International Society for Optical Engineering). doi: 10.1117/12.2500857, 10.15488/10272
Luo, Hang ; Pape, Christian ; Reithmeier, Eduard. / Robust direct vision-based pose tracking using normalized mutual information. Optical Metrology and Inspection for Industrial Applications V. editor / Toru Yoshizawa ; Song Zhang ; Sen Han ; Sen Han. SPIE, 2018. (Proceedings of SPIE - The International Society for Optical Engineering).
Download
@inproceedings{24c858c884fc4823ab5c4ed9cf6a33d3,
title = "Robust direct vision-based pose tracking using normalized mutual information",
abstract = "This paper presents a novel visual tracking approach that combines the NMI metric and the traditional SSD metric within a gradient-based optimization frame, which can be used for direct visual odometry and SLAM. We firstly derivate the closed form expression for first- and second-order analytical NMI derivatives under the assumption of rigid-body transformations, which then can be used by subsequent Newton-like optimization methods. Then we develop a robust tracking scheme that utilizes the robustness of NMI metric while keeping the optimization characteristics of SSD-based Lucas-Kanade (LK) tracking methods. To validate the robustness and accuracy of the proposed approach, several experiments are performed on synthetic datasets as well as real image datasets. The experimental results demonstrate that our approach can provide fast, accurate pose estimation and obtain better tracking performance over standard SSD-based methods in most cases.",
keywords = "Direct visual tracking, Nonlinear optimization, Normalized mutual information, Sum of squared differences",
author = "Hang Luo and Christian Pape and Eduard Reithmeier",
year = "2018",
month = nov,
day = "2",
doi = "10.1117/12.2500857",
language = "English",
series = "Proceedings of SPIE - The International Society for Optical Engineering",
publisher = "SPIE",
editor = "Toru Yoshizawa and Song Zhang and Sen Han and Sen Han",
booktitle = "Optical Metrology and Inspection for Industrial Applications V",
address = "United States",
note = "Optical Metrology and Inspection for Industrial Applications V 2018 ; Conference date: 11-10-2018 Through 13-10-2018",

}

Download

TY - GEN

T1 - Robust direct vision-based pose tracking using normalized mutual information

AU - Luo, Hang

AU - Pape, Christian

AU - Reithmeier, Eduard

PY - 2018/11/2

Y1 - 2018/11/2

N2 - This paper presents a novel visual tracking approach that combines the NMI metric and the traditional SSD metric within a gradient-based optimization frame, which can be used for direct visual odometry and SLAM. We firstly derivate the closed form expression for first- and second-order analytical NMI derivatives under the assumption of rigid-body transformations, which then can be used by subsequent Newton-like optimization methods. Then we develop a robust tracking scheme that utilizes the robustness of NMI metric while keeping the optimization characteristics of SSD-based Lucas-Kanade (LK) tracking methods. To validate the robustness and accuracy of the proposed approach, several experiments are performed on synthetic datasets as well as real image datasets. The experimental results demonstrate that our approach can provide fast, accurate pose estimation and obtain better tracking performance over standard SSD-based methods in most cases.

AB - This paper presents a novel visual tracking approach that combines the NMI metric and the traditional SSD metric within a gradient-based optimization frame, which can be used for direct visual odometry and SLAM. We firstly derivate the closed form expression for first- and second-order analytical NMI derivatives under the assumption of rigid-body transformations, which then can be used by subsequent Newton-like optimization methods. Then we develop a robust tracking scheme that utilizes the robustness of NMI metric while keeping the optimization characteristics of SSD-based Lucas-Kanade (LK) tracking methods. To validate the robustness and accuracy of the proposed approach, several experiments are performed on synthetic datasets as well as real image datasets. The experimental results demonstrate that our approach can provide fast, accurate pose estimation and obtain better tracking performance over standard SSD-based methods in most cases.

KW - Direct visual tracking

KW - Nonlinear optimization

KW - Normalized mutual information

KW - Sum of squared differences

UR - http://www.scopus.com/inward/record.url?scp=85059357461&partnerID=8YFLogxK

U2 - 10.1117/12.2500857

DO - 10.1117/12.2500857

M3 - Conference contribution

AN - SCOPUS:85059357461

T3 - Proceedings of SPIE - The International Society for Optical Engineering

BT - Optical Metrology and Inspection for Industrial Applications V

A2 - Yoshizawa, Toru

A2 - Zhang, Song

A2 - Han, Sen

A2 - Han, Sen

PB - SPIE

T2 - Optical Metrology and Inspection for Industrial Applications V 2018

Y2 - 11 October 2018 through 13 October 2018

ER -

By the same author(s)