Markerless motion capture with unsynchronized moving cameras

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Authors

  • Nils Hasler
  • Bodo Rosenhahn
  • Thorsten Thormählen
  • Michael Wand
  • Juergen Gall
  • Hans Peter Seidel

Research Organisations

External Research Organisations

  • ETH Zurich
  • Max-Planck Institute for Informatics
View graph of relations

Details

Original languageEnglish
Title of host publication2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, CVPR Workshops 2009
PublisherIEEE Computer Society
Pages224-231
Number of pages8
ISBN (print)9781424439935
Publication statusPublished - 2009
Event2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Miami, FL, United States
Duration: 20 Jun 200925 Jun 2009

Publication series

Name2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, CVPR Workshops 2009
Volume2009 IEEE

Abstract

In this work we present an approach for markerless motion capture (MoCap) of articulated objects, which are recorded with multiple unsynchronized moving cameras. Instead of using fixed (and expensive) hardware synchronized cameras, this approach allows us to track people with off-the-shelf handheld video cameras. To prepare a sequence for motion capture, we first reconstruct the static background and the position of each camera using Structure-from-Motion (SfM). Then the cameras are registered to each other using the reconstructed static background geometry. Camera synchronization is achieved via the audio streams recorded by the cameras in parallel. Finally, a markerless MoCap approach is applied to recover positions and joint configurations of subjects. Feature tracks and dense background geometry are further used to stabilize the MoCap. The experiments show examples with highly challenging indoor and outdoor scenes.

ASJC Scopus subject areas

Cite this

Markerless motion capture with unsynchronized moving cameras. / Hasler, Nils; Rosenhahn, Bodo; Thormählen, Thorsten et al.
2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, CVPR Workshops 2009. IEEE Computer Society, 2009. p. 224-231 5206859 (2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, CVPR Workshops 2009; Vol. 2009 IEEE).

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Hasler, N, Rosenhahn, B, Thormählen, T, Wand, M, Gall, J & Seidel, HP 2009, Markerless motion capture with unsynchronized moving cameras. in 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, CVPR Workshops 2009., 5206859, 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, CVPR Workshops 2009, vol. 2009 IEEE, IEEE Computer Society, pp. 224-231, 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Miami, FL, United States, 20 Jun 2009. https://doi.org/10.1109/CVPRW.2009.5206859
Hasler, N., Rosenhahn, B., Thormählen, T., Wand, M., Gall, J., & Seidel, H. P. (2009). Markerless motion capture with unsynchronized moving cameras. In 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, CVPR Workshops 2009 (pp. 224-231). Article 5206859 (2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, CVPR Workshops 2009; Vol. 2009 IEEE). IEEE Computer Society. https://doi.org/10.1109/CVPRW.2009.5206859
Hasler N, Rosenhahn B, Thormählen T, Wand M, Gall J, Seidel HP. Markerless motion capture with unsynchronized moving cameras. In 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, CVPR Workshops 2009. IEEE Computer Society. 2009. p. 224-231. 5206859. (2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, CVPR Workshops 2009). doi: 10.1109/CVPRW.2009.5206859
Hasler, Nils ; Rosenhahn, Bodo ; Thormählen, Thorsten et al. / Markerless motion capture with unsynchronized moving cameras. 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, CVPR Workshops 2009. IEEE Computer Society, 2009. pp. 224-231 (2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, CVPR Workshops 2009).
Download
@inproceedings{f6593f1c4a8c417db48b315be798a92e,
title = "Markerless motion capture with unsynchronized moving cameras",
abstract = "In this work we present an approach for markerless motion capture (MoCap) of articulated objects, which are recorded with multiple unsynchronized moving cameras. Instead of using fixed (and expensive) hardware synchronized cameras, this approach allows us to track people with off-the-shelf handheld video cameras. To prepare a sequence for motion capture, we first reconstruct the static background and the position of each camera using Structure-from-Motion (SfM). Then the cameras are registered to each other using the reconstructed static background geometry. Camera synchronization is achieved via the audio streams recorded by the cameras in parallel. Finally, a markerless MoCap approach is applied to recover positions and joint configurations of subjects. Feature tracks and dense background geometry are further used to stabilize the MoCap. The experiments show examples with highly challenging indoor and outdoor scenes.",
author = "Nils Hasler and Bodo Rosenhahn and Thorsten Thorm{\"a}hlen and Michael Wand and Juergen Gall and Seidel, {Hans Peter}",
year = "2009",
doi = "10.1109/CVPRW.2009.5206859",
language = "English",
isbn = "9781424439935",
series = "2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, CVPR Workshops 2009",
publisher = "IEEE Computer Society",
pages = "224--231",
booktitle = "2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, CVPR Workshops 2009",
address = "United States",
note = "2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition ; Conference date: 20-06-2009 Through 25-06-2009",

}

Download

TY - GEN

T1 - Markerless motion capture with unsynchronized moving cameras

AU - Hasler, Nils

AU - Rosenhahn, Bodo

AU - Thormählen, Thorsten

AU - Wand, Michael

AU - Gall, Juergen

AU - Seidel, Hans Peter

PY - 2009

Y1 - 2009

N2 - In this work we present an approach for markerless motion capture (MoCap) of articulated objects, which are recorded with multiple unsynchronized moving cameras. Instead of using fixed (and expensive) hardware synchronized cameras, this approach allows us to track people with off-the-shelf handheld video cameras. To prepare a sequence for motion capture, we first reconstruct the static background and the position of each camera using Structure-from-Motion (SfM). Then the cameras are registered to each other using the reconstructed static background geometry. Camera synchronization is achieved via the audio streams recorded by the cameras in parallel. Finally, a markerless MoCap approach is applied to recover positions and joint configurations of subjects. Feature tracks and dense background geometry are further used to stabilize the MoCap. The experiments show examples with highly challenging indoor and outdoor scenes.

AB - In this work we present an approach for markerless motion capture (MoCap) of articulated objects, which are recorded with multiple unsynchronized moving cameras. Instead of using fixed (and expensive) hardware synchronized cameras, this approach allows us to track people with off-the-shelf handheld video cameras. To prepare a sequence for motion capture, we first reconstruct the static background and the position of each camera using Structure-from-Motion (SfM). Then the cameras are registered to each other using the reconstructed static background geometry. Camera synchronization is achieved via the audio streams recorded by the cameras in parallel. Finally, a markerless MoCap approach is applied to recover positions and joint configurations of subjects. Feature tracks and dense background geometry are further used to stabilize the MoCap. The experiments show examples with highly challenging indoor and outdoor scenes.

UR - http://www.scopus.com/inward/record.url?scp=70450162951&partnerID=8YFLogxK

U2 - 10.1109/CVPRW.2009.5206859

DO - 10.1109/CVPRW.2009.5206859

M3 - Conference contribution

AN - SCOPUS:70450162951

SN - 9781424439935

T3 - 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, CVPR Workshops 2009

SP - 224

EP - 231

BT - 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, CVPR Workshops 2009

PB - IEEE Computer Society

T2 - 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition

Y2 - 20 June 2009 through 25 June 2009

ER -

By the same author(s)