Motion capture using joint skeleton tracking and surface estimation

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Authors

  • Juergen Gall
  • Carsten Stoll
  • Edilson De Aguiar
  • Christian Theobalt
  • Bodo Rosenhahn
  • Hans Peter Seidel

Research Organisations

External Research Organisations

  • ETH Zurich
  • Max-Planck Institute for Informatics
  • Stanford University
View graph of relations

Details

Original languageEnglish
Title of host publication2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, CVPR Workshops 2009
PublisherIEEE Computer Society
Pages1746-1753
Number of pages8
ISBN (print)9781424439935
Publication statusPublished - 2009
Event2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Miami, FL, United States
Duration: 20 Jun 200925 Jun 2009

Publication series

Name2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, CVPR Workshops 2009
Volume2009 IEEE Computer Society Conference on Computer Vision and ...

Abstract

This paper proposes a method for capturing the performance of a human or an animal from a multi-view video sequence. Given an articulated template model and silhouettes from a multi-view image sequence, our approach recovers not only the movement of the skeleton, but also the possibly non-rigid temporal deformation of the 3D surface. While large scale deformations or fast movements are captured by the skeleton pose and approximate surface skinning, true small scale deformations or non-rigid garment motion are captured by fitting the surface to the silhouette. We further propose a novel optimization scheme for skeleton-based pose estimation that exploits the skeleton's tree structure to split the optimization problem into a local one and a lower dimensional global one. We show on various sequences that our approach can capture the 3D motion of animals and humans accurately even in the case of rapid movements and wide apparel like skirts.

ASJC Scopus subject areas

Cite this

Motion capture using joint skeleton tracking and surface estimation. / Gall, Juergen; Stoll, Carsten; De Aguiar, Edilson et al.
2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, CVPR Workshops 2009. IEEE Computer Society, 2009. p. 1746-1753 5206755 (2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, CVPR Workshops 2009; Vol. 2009 IEEE Computer Society Conference on Computer Vision and ...).

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Gall, J, Stoll, C, De Aguiar, E, Theobalt, C, Rosenhahn, B & Seidel, HP 2009, Motion capture using joint skeleton tracking and surface estimation. in 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, CVPR Workshops 2009., 5206755, 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, CVPR Workshops 2009, vol. 2009 IEEE Computer Society Conference on Computer Vision and ..., IEEE Computer Society, pp. 1746-1753, 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Miami, FL, United States, 20 Jun 2009. https://doi.org/10.1109/CVPRW.2009.5206755
Gall, J., Stoll, C., De Aguiar, E., Theobalt, C., Rosenhahn, B., & Seidel, H. P. (2009). Motion capture using joint skeleton tracking and surface estimation. In 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, CVPR Workshops 2009 (pp. 1746-1753). Article 5206755 (2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, CVPR Workshops 2009; Vol. 2009 IEEE Computer Society Conference on Computer Vision and ...). IEEE Computer Society. https://doi.org/10.1109/CVPRW.2009.5206755
Gall J, Stoll C, De Aguiar E, Theobalt C, Rosenhahn B, Seidel HP. Motion capture using joint skeleton tracking and surface estimation. In 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, CVPR Workshops 2009. IEEE Computer Society. 2009. p. 1746-1753. 5206755. (2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, CVPR Workshops 2009). doi: 10.1109/CVPRW.2009.5206755
Gall, Juergen ; Stoll, Carsten ; De Aguiar, Edilson et al. / Motion capture using joint skeleton tracking and surface estimation. 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, CVPR Workshops 2009. IEEE Computer Society, 2009. pp. 1746-1753 (2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, CVPR Workshops 2009).
Download
@inproceedings{a7ec4b6230764c25befc6e800cb9a544,
title = "Motion capture using joint skeleton tracking and surface estimation",
abstract = "This paper proposes a method for capturing the performance of a human or an animal from a multi-view video sequence. Given an articulated template model and silhouettes from a multi-view image sequence, our approach recovers not only the movement of the skeleton, but also the possibly non-rigid temporal deformation of the 3D surface. While large scale deformations or fast movements are captured by the skeleton pose and approximate surface skinning, true small scale deformations or non-rigid garment motion are captured by fitting the surface to the silhouette. We further propose a novel optimization scheme for skeleton-based pose estimation that exploits the skeleton's tree structure to split the optimization problem into a local one and a lower dimensional global one. We show on various sequences that our approach can capture the 3D motion of animals and humans accurately even in the case of rapid movements and wide apparel like skirts.",
author = "Juergen Gall and Carsten Stoll and {De Aguiar}, Edilson and Christian Theobalt and Bodo Rosenhahn and Seidel, {Hans Peter}",
year = "2009",
doi = "10.1109/CVPRW.2009.5206755",
language = "English",
isbn = "9781424439935",
series = "2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, CVPR Workshops 2009",
publisher = "IEEE Computer Society",
pages = "1746--1753",
booktitle = "2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, CVPR Workshops 2009",
address = "United States",
note = "2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition ; Conference date: 20-06-2009 Through 25-06-2009",

}

Download

TY - GEN

T1 - Motion capture using joint skeleton tracking and surface estimation

AU - Gall, Juergen

AU - Stoll, Carsten

AU - De Aguiar, Edilson

AU - Theobalt, Christian

AU - Rosenhahn, Bodo

AU - Seidel, Hans Peter

PY - 2009

Y1 - 2009

N2 - This paper proposes a method for capturing the performance of a human or an animal from a multi-view video sequence. Given an articulated template model and silhouettes from a multi-view image sequence, our approach recovers not only the movement of the skeleton, but also the possibly non-rigid temporal deformation of the 3D surface. While large scale deformations or fast movements are captured by the skeleton pose and approximate surface skinning, true small scale deformations or non-rigid garment motion are captured by fitting the surface to the silhouette. We further propose a novel optimization scheme for skeleton-based pose estimation that exploits the skeleton's tree structure to split the optimization problem into a local one and a lower dimensional global one. We show on various sequences that our approach can capture the 3D motion of animals and humans accurately even in the case of rapid movements and wide apparel like skirts.

AB - This paper proposes a method for capturing the performance of a human or an animal from a multi-view video sequence. Given an articulated template model and silhouettes from a multi-view image sequence, our approach recovers not only the movement of the skeleton, but also the possibly non-rigid temporal deformation of the 3D surface. While large scale deformations or fast movements are captured by the skeleton pose and approximate surface skinning, true small scale deformations or non-rigid garment motion are captured by fitting the surface to the silhouette. We further propose a novel optimization scheme for skeleton-based pose estimation that exploits the skeleton's tree structure to split the optimization problem into a local one and a lower dimensional global one. We show on various sequences that our approach can capture the 3D motion of animals and humans accurately even in the case of rapid movements and wide apparel like skirts.

UR - http://www.scopus.com/inward/record.url?scp=70450199826&partnerID=8YFLogxK

U2 - 10.1109/CVPRW.2009.5206755

DO - 10.1109/CVPRW.2009.5206755

M3 - Conference contribution

AN - SCOPUS:70450199826

SN - 9781424439935

T3 - 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, CVPR Workshops 2009

SP - 1746

EP - 1753

BT - 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, CVPR Workshops 2009

PB - IEEE Computer Society

T2 - 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition

Y2 - 20 June 2009 through 25 June 2009

ER -

By the same author(s)