Details
| Original language | English |
|---|---|
| Pages (from-to) | 52-69 |
| Number of pages | 18 |
| Journal | Annals of the New York Academy of Sciences |
| Volume | 1425 |
| Issue number | 1 |
| Early online date | 16 May 2018 |
| Publication status | Published - Aug 2018 |
Abstract
Many domains of human behavior are based on multisensory representations. Knowledge about the principles of multisensory integration is useful to configure real-time movement information for the online support of perceptuo-motor processes (motor perception, control, and learning). A powerful method for generating real-time information is movement sonification. Remarkable evidence exists on movement-acoustic real-time information being effective in behavioral domains (music training, motor rehabilitation, sports). Here, we investigate whether and how biological motion perception can be enhanced, substituted, or modulated by kinematic sonification, with a focus on pitch coding. We work with gross motor cyclic movements and investigate the effectiveness of pitch scaling and consistent transposition on audiovisual motor perception accuracy (Experiment A). Beyond that, a new kind of audiovisual stimulus with inconsistent pitch transposition is used to produce a directed modulation of the integrated audiovisual percept (Experiment B). Results from Experiment A indicate pitch being powerful for mediating kinematic information to enhance motor perception and substituting information between perceptual modalities, even exceeding visual performance. Beyond these findings, results from Experiment B indicate that visual estimations of movement velocity can be enhanced or reduced auditorily. Movement sonification used for reshaping intermodal adjustments should be a powerful new tool for subconsciously shaping human movement patterns in the future.
Keywords
- Biological motion perception, Intermodal adjustment, Motor rehabilitation, Movement sonification, Multisensory integration, Multisensory representation
ASJC Scopus subject areas
- Neuroscience(all)
- General Neuroscience
- Biochemistry, Genetics and Molecular Biology(all)
- General Biochemistry,Genetics and Molecular Biology
- Arts and Humanities(all)
- History and Philosophy of Science
Cite this
- Standard
- Harvard
- Apa
- Vancouver
- BibTeX
- RIS
In: Annals of the New York Academy of Sciences, Vol. 1425, No. 1, 08.2018, p. 52-69.
Research output: Contribution to journal › Article › Research › peer review
}
TY - JOUR
T1 - Acceleration and deceleration at constant speed: Systematic modulation of motion perception by kinematic sonification
AU - Effenberg, Alfred Oliver
AU - Schmitz, Gerd
N1 - Funding information: Parts of this work were supported by EC H2020-FETPROACT-2014 No. 641321.
PY - 2018/8
Y1 - 2018/8
N2 - Many domains of human behavior are based on multisensory representations. Knowledge about the principles of multisensory integration is useful to configure real-time movement information for the online support of perceptuo-motor processes (motor perception, control, and learning). A powerful method for generating real-time information is movement sonification. Remarkable evidence exists on movement-acoustic real-time information being effective in behavioral domains (music training, motor rehabilitation, sports). Here, we investigate whether and how biological motion perception can be enhanced, substituted, or modulated by kinematic sonification, with a focus on pitch coding. We work with gross motor cyclic movements and investigate the effectiveness of pitch scaling and consistent transposition on audiovisual motor perception accuracy (Experiment A). Beyond that, a new kind of audiovisual stimulus with inconsistent pitch transposition is used to produce a directed modulation of the integrated audiovisual percept (Experiment B). Results from Experiment A indicate pitch being powerful for mediating kinematic information to enhance motor perception and substituting information between perceptual modalities, even exceeding visual performance. Beyond these findings, results from Experiment B indicate that visual estimations of movement velocity can be enhanced or reduced auditorily. Movement sonification used for reshaping intermodal adjustments should be a powerful new tool for subconsciously shaping human movement patterns in the future.
AB - Many domains of human behavior are based on multisensory representations. Knowledge about the principles of multisensory integration is useful to configure real-time movement information for the online support of perceptuo-motor processes (motor perception, control, and learning). A powerful method for generating real-time information is movement sonification. Remarkable evidence exists on movement-acoustic real-time information being effective in behavioral domains (music training, motor rehabilitation, sports). Here, we investigate whether and how biological motion perception can be enhanced, substituted, or modulated by kinematic sonification, with a focus on pitch coding. We work with gross motor cyclic movements and investigate the effectiveness of pitch scaling and consistent transposition on audiovisual motor perception accuracy (Experiment A). Beyond that, a new kind of audiovisual stimulus with inconsistent pitch transposition is used to produce a directed modulation of the integrated audiovisual percept (Experiment B). Results from Experiment A indicate pitch being powerful for mediating kinematic information to enhance motor perception and substituting information between perceptual modalities, even exceeding visual performance. Beyond these findings, results from Experiment B indicate that visual estimations of movement velocity can be enhanced or reduced auditorily. Movement sonification used for reshaping intermodal adjustments should be a powerful new tool for subconsciously shaping human movement patterns in the future.
KW - Biological motion perception
KW - Intermodal adjustment
KW - Motor rehabilitation
KW - Movement sonification
KW - Multisensory integration
KW - Multisensory representation
UR - http://www.scopus.com/inward/record.url?scp=85047489928&partnerID=8YFLogxK
U2 - 10.15488/4950
DO - 10.15488/4950
M3 - Article
VL - 1425
SP - 52
EP - 69
JO - Annals of the New York Academy of Sciences
JF - Annals of the New York Academy of Sciences
SN - 0077-8923
IS - 1
ER -