Performance of Image Registration and Its Extensions for Interpolation of Facial Motion

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Authors

Research Organisations

View graph of relations

Details

Original languageEnglish
Title of host publicationImage and Video Technology - PSIVT 2013 Workshops
Subtitle of host publicationGCCV 2013, GPID 2013, PAESNPR 2013, and QACIVA 2013, Revised Selected Papers
EditorsFay Huang, Akihiro Sugimoto
PublisherSpringer Verlag
Pages216-227
Number of pages12
ISBN (electronic)9783642539251
Publication statusPublished - 2014
Event6th Pacific-Rim Symposium on Image and Video Technology, PSIVT 2013 with GCCV 2013, GPID 2013, PAESNPR 2013, and QACIVA 2013 - Guanajuato, Mexico
Duration: 28 Oct 201329 Oct 2013

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume8334
ISSN (Print)0302-9743
ISSN (electronic)1611-3349

Abstract

We compare the performance of an intensity based nonparametric image registration algorithm and extensions applied to frame interpolation of mouth images. The mouth exhibits large deformations due to different shapes, additionally some facial features occlude others, e.g. the lips cover the teeth. The closures and disclosures represent a challenging problem, which cannot be solved by the traditional image registration algorithms. The tested extensions include local regularizer weight adaptation, incorporation of landmarks, self-occlusion handling and penalization of folds, which have all been examined with different weight parameters. Since the performance of these algorithms and extensions turns out to be superior in case of mouth closures, we provide an algorithm for the automatic selection of deformable template and static reference image for the registration procedure. Subjective tests show that the quality of results for interpolation of mouth images is enhanced by this proposal.

Keywords

    Facial motion, Frame interpolation, Nonparametric image registration, Numeric optimization, Optical flow, Variational

ASJC Scopus subject areas

Cite this

Performance of Image Registration and Its Extensions for Interpolation of Facial Motion. / Grasshof, Stella; Ostermann, Jörn.
Image and Video Technology - PSIVT 2013 Workshops : GCCV 2013, GPID 2013, PAESNPR 2013, and QACIVA 2013, Revised Selected Papers. ed. / Fay Huang; Akihiro Sugimoto. Springer Verlag, 2014. p. 216-227 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 8334).

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Grasshof, S & Ostermann, J 2014, Performance of Image Registration and Its Extensions for Interpolation of Facial Motion. in F Huang & A Sugimoto (eds), Image and Video Technology - PSIVT 2013 Workshops : GCCV 2013, GPID 2013, PAESNPR 2013, and QACIVA 2013, Revised Selected Papers. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 8334, Springer Verlag, pp. 216-227, 6th Pacific-Rim Symposium on Image and Video Technology, PSIVT 2013 with GCCV 2013, GPID 2013, PAESNPR 2013, and QACIVA 2013, Guanajuato, Mexico, 28 Oct 2013. https://doi.org/10.1007/978-3-642-53926-8_20
Grasshof, S., & Ostermann, J. (2014). Performance of Image Registration and Its Extensions for Interpolation of Facial Motion. In F. Huang, & A. Sugimoto (Eds.), Image and Video Technology - PSIVT 2013 Workshops : GCCV 2013, GPID 2013, PAESNPR 2013, and QACIVA 2013, Revised Selected Papers (pp. 216-227). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 8334). Springer Verlag. https://doi.org/10.1007/978-3-642-53926-8_20
Grasshof S, Ostermann J. Performance of Image Registration and Its Extensions for Interpolation of Facial Motion. In Huang F, Sugimoto A, editors, Image and Video Technology - PSIVT 2013 Workshops : GCCV 2013, GPID 2013, PAESNPR 2013, and QACIVA 2013, Revised Selected Papers. Springer Verlag. 2014. p. 216-227. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.1007/978-3-642-53926-8_20
Grasshof, Stella ; Ostermann, Jörn. / Performance of Image Registration and Its Extensions for Interpolation of Facial Motion. Image and Video Technology - PSIVT 2013 Workshops : GCCV 2013, GPID 2013, PAESNPR 2013, and QACIVA 2013, Revised Selected Papers. editor / Fay Huang ; Akihiro Sugimoto. Springer Verlag, 2014. pp. 216-227 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
Download
@inproceedings{af24a3c66bfe48c3ab07a816782aa00e,
title = "Performance of Image Registration and Its Extensions for Interpolation of Facial Motion",
abstract = "We compare the performance of an intensity based nonparametric image registration algorithm and extensions applied to frame interpolation of mouth images. The mouth exhibits large deformations due to different shapes, additionally some facial features occlude others, e.g. the lips cover the teeth. The closures and disclosures represent a challenging problem, which cannot be solved by the traditional image registration algorithms. The tested extensions include local regularizer weight adaptation, incorporation of landmarks, self-occlusion handling and penalization of folds, which have all been examined with different weight parameters. Since the performance of these algorithms and extensions turns out to be superior in case of mouth closures, we provide an algorithm for the automatic selection of deformable template and static reference image for the registration procedure. Subjective tests show that the quality of results for interpolation of mouth images is enhanced by this proposal.",
keywords = "Facial motion, Frame interpolation, Nonparametric image registration, Numeric optimization, Optical flow, Variational",
author = "Stella Grasshof and J{\"o}rn Ostermann",
year = "2014",
doi = "10.1007/978-3-642-53926-8_20",
language = "English",
series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
publisher = "Springer Verlag",
pages = "216--227",
editor = "Fay Huang and Akihiro Sugimoto",
booktitle = "Image and Video Technology - PSIVT 2013 Workshops",
address = "Germany",
note = "6th Pacific-Rim Symposium on Image and Video Technology, PSIVT 2013 with GCCV 2013, GPID 2013, PAESNPR 2013, and QACIVA 2013 ; Conference date: 28-10-2013 Through 29-10-2013",

}

Download

TY - GEN

T1 - Performance of Image Registration and Its Extensions for Interpolation of Facial Motion

AU - Grasshof, Stella

AU - Ostermann, Jörn

PY - 2014

Y1 - 2014

N2 - We compare the performance of an intensity based nonparametric image registration algorithm and extensions applied to frame interpolation of mouth images. The mouth exhibits large deformations due to different shapes, additionally some facial features occlude others, e.g. the lips cover the teeth. The closures and disclosures represent a challenging problem, which cannot be solved by the traditional image registration algorithms. The tested extensions include local regularizer weight adaptation, incorporation of landmarks, self-occlusion handling and penalization of folds, which have all been examined with different weight parameters. Since the performance of these algorithms and extensions turns out to be superior in case of mouth closures, we provide an algorithm for the automatic selection of deformable template and static reference image for the registration procedure. Subjective tests show that the quality of results for interpolation of mouth images is enhanced by this proposal.

AB - We compare the performance of an intensity based nonparametric image registration algorithm and extensions applied to frame interpolation of mouth images. The mouth exhibits large deformations due to different shapes, additionally some facial features occlude others, e.g. the lips cover the teeth. The closures and disclosures represent a challenging problem, which cannot be solved by the traditional image registration algorithms. The tested extensions include local regularizer weight adaptation, incorporation of landmarks, self-occlusion handling and penalization of folds, which have all been examined with different weight parameters. Since the performance of these algorithms and extensions turns out to be superior in case of mouth closures, we provide an algorithm for the automatic selection of deformable template and static reference image for the registration procedure. Subjective tests show that the quality of results for interpolation of mouth images is enhanced by this proposal.

KW - Facial motion

KW - Frame interpolation

KW - Nonparametric image registration

KW - Numeric optimization

KW - Optical flow

KW - Variational

UR - http://www.scopus.com/inward/record.url?scp=84927665978&partnerID=8YFLogxK

U2 - 10.1007/978-3-642-53926-8_20

DO - 10.1007/978-3-642-53926-8_20

M3 - Conference contribution

AN - SCOPUS:84927665978

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 216

EP - 227

BT - Image and Video Technology - PSIVT 2013 Workshops

A2 - Huang, Fay

A2 - Sugimoto, Akihiro

PB - Springer Verlag

T2 - 6th Pacific-Rim Symposium on Image and Video Technology, PSIVT 2013 with GCCV 2013, GPID 2013, PAESNPR 2013, and QACIVA 2013

Y2 - 28 October 2013 through 29 October 2013

ER -

By the same author(s)