Interactive multi-object tracking for virtual object manipulation

Publikation: Beitrag in FachzeitschriftKonferenzaufsatz in FachzeitschriftForschungPeer-Review

Autoren

Forschungs-netzwerk anzeigen

Details

OriginalspracheEnglisch
Seiten (von - bis)19-24
Seitenumfang6
FachzeitschriftISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences
Jahrgang2
Ausgabenummer3W2
PublikationsstatusVeröffentlicht - 2 Okt. 2013
Veranstaltung2013 ISPRS Workshop on Image Sequence Analysis, ISA 2013 - Antalya, Türkei
Dauer: 11 Nov. 201311 Nov. 2013

Abstract

We present an interactive system to manipulate a virtual object by tracking multiple hands in 3D space using a Kinect device. The system segments hand shapes from a captured 3D scene by using depth information and active contours. A hand shape is recognized by a trained naive Bayes classifier, whether it belongs to a palm, a pointing hand form or both hands with simple occlusion. A plane is approximated by using RANSAC for a palm hand form, while a vector from the hand centroid to the fingertip is obtained for a pointing hand form by using ICP as tracking method. A shape of simple occluded two hands is split into a palm and an incomplete pointing hand form, whose missing data is estimated by using PCA. The system works in semi-real time.

ASJC Scopus Sachgebiete

Zitieren

Interactive multi-object tracking for virtual object manipulation. / Guo, Yibo; Yang, Michael Ying; Rosenhahn, Bodo.
in: ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Jahrgang 2, Nr. 3W2, 02.10.2013, S. 19-24.

Publikation: Beitrag in FachzeitschriftKonferenzaufsatz in FachzeitschriftForschungPeer-Review

Guo, Y, Yang, MY & Rosenhahn, B 2013, 'Interactive multi-object tracking for virtual object manipulation', ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Jg. 2, Nr. 3W2, S. 19-24. https://doi.org/10.5194/isprsannals-II-3-W2-19-2013
Guo, Y., Yang, M. Y., & Rosenhahn, B. (2013). Interactive multi-object tracking for virtual object manipulation. ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, 2(3W2), 19-24. https://doi.org/10.5194/isprsannals-II-3-W2-19-2013
Guo Y, Yang MY, Rosenhahn B. Interactive multi-object tracking for virtual object manipulation. ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences. 2013 Okt 2;2(3W2):19-24. doi: 10.5194/isprsannals-II-3-W2-19-2013
Guo, Yibo ; Yang, Michael Ying ; Rosenhahn, Bodo. / Interactive multi-object tracking for virtual object manipulation. in: ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences. 2013 ; Jahrgang 2, Nr. 3W2. S. 19-24.
Download
@article{46564988177c43d2be3d2bd95373a9e4,
title = "Interactive multi-object tracking for virtual object manipulation",
abstract = "We present an interactive system to manipulate a virtual object by tracking multiple hands in 3D space using a Kinect device. The system segments hand shapes from a captured 3D scene by using depth information and active contours. A hand shape is recognized by a trained naive Bayes classifier, whether it belongs to a palm, a pointing hand form or both hands with simple occlusion. A plane is approximated by using RANSAC for a palm hand form, while a vector from the hand centroid to the fingertip is obtained for a pointing hand form by using ICP as tracking method. A shape of simple occluded two hands is split into a palm and an incomplete pointing hand form, whose missing data is estimated by using PCA. The system works in semi-real time.",
keywords = "1D signature, Gesture recognition, ICP, Kinect, Multiple object tracking",
author = "Yibo Guo and Yang, {Michael Ying} and Bodo Rosenhahn",
year = "2013",
month = oct,
day = "2",
doi = "10.5194/isprsannals-II-3-W2-19-2013",
language = "English",
volume = "2",
pages = "19--24",
number = "3W2",
note = "2013 ISPRS Workshop on Image Sequence Analysis, ISA 2013 ; Conference date: 11-11-2013 Through 11-11-2013",

}

Download

TY - JOUR

T1 - Interactive multi-object tracking for virtual object manipulation

AU - Guo, Yibo

AU - Yang, Michael Ying

AU - Rosenhahn, Bodo

PY - 2013/10/2

Y1 - 2013/10/2

N2 - We present an interactive system to manipulate a virtual object by tracking multiple hands in 3D space using a Kinect device. The system segments hand shapes from a captured 3D scene by using depth information and active contours. A hand shape is recognized by a trained naive Bayes classifier, whether it belongs to a palm, a pointing hand form or both hands with simple occlusion. A plane is approximated by using RANSAC for a palm hand form, while a vector from the hand centroid to the fingertip is obtained for a pointing hand form by using ICP as tracking method. A shape of simple occluded two hands is split into a palm and an incomplete pointing hand form, whose missing data is estimated by using PCA. The system works in semi-real time.

AB - We present an interactive system to manipulate a virtual object by tracking multiple hands in 3D space using a Kinect device. The system segments hand shapes from a captured 3D scene by using depth information and active contours. A hand shape is recognized by a trained naive Bayes classifier, whether it belongs to a palm, a pointing hand form or both hands with simple occlusion. A plane is approximated by using RANSAC for a palm hand form, while a vector from the hand centroid to the fingertip is obtained for a pointing hand form by using ICP as tracking method. A shape of simple occluded two hands is split into a palm and an incomplete pointing hand form, whose missing data is estimated by using PCA. The system works in semi-real time.

KW - 1D signature

KW - Gesture recognition

KW - ICP

KW - Kinect

KW - Multiple object tracking

UR - http://www.scopus.com/inward/record.url?scp=85048919649&partnerID=8YFLogxK

U2 - 10.5194/isprsannals-II-3-W2-19-2013

DO - 10.5194/isprsannals-II-3-W2-19-2013

M3 - Conference article

AN - SCOPUS:85048919649

VL - 2

SP - 19

EP - 24

JO - ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences

JF - ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences

SN - 2194-9042

IS - 3W2

T2 - 2013 ISPRS Workshop on Image Sequence Analysis, ISA 2013

Y2 - 11 November 2013 through 11 November 2013

ER -

Von denselben Autoren