The influence of the DRR on audio-visual coherence of a real loudspeaker playing virtually over headphones

Tag / Zeit: 17.08.2021, 17:20-17:40
Raum: Lehar 1
Typ: Regulärer Vortrag
Online-Zugang: Bitte loggen Sie sich ein, damit weitere Inhalte sichtbar werden (bspw. der Zugang zur Onlinesitzung).
Zusammenfassung: One of the challenges in realizing auditory augmented reality is the audio-visual alignment of virtual sound sources created with dynamic binaural synthesis over headphones with the real visual object. In this study the influence of the direct-to-reverberant energy ratio (DRR) on the audio-visual coherence is investigated. In this regard an AR scenario was realized in which two real loudspeakers, one of the reproducing sound only virtually in a reverberant seminar room (RT = 1.0s). A listening test was conducted to evaluate the audible effects of a step-wise manipulation of the DRR in the BRIRs. In addition, BRIRs without the consideration of the headphone shadowing effects were preferred, despite the presence of the a continuously playing real sound source. The results of the study indicate that a variation of the actual DRR by ±3dB affected the audio-visual coherence noticeably.