Webbläsaren som du använder stöds inte av denna webbplats. Alla versioner av Internet Explorer stöds inte längre, av oss eller Microsoft (läs mer här: * https://www.microsoft.com/en-us/microsoft-365/windows/end-of-ie-support).

Var god och använd en modern webbläsare för att ta del av denna webbplats, som t.ex. nyaste versioner av Edge, Chrome, Firefox eller Safari osv.

Compensation for a large gesture-speech asynchrony in instructional videos

In English

Författare

Redaktör

  • Gaëlle Ferré
  • Mark Tutton

Summary, in English

We investigated the pragmatic effects of gesture-speech lag by asking participants to reconstruct formations of geometric shapes based on instructional films in four conditions: sync, video or audio lag (±1,500 ms), audio only. All three video groups rated the task as less difficult compared to the audio-only group and performed better. The scores were slightly lower when sound preceded gestures (video lag), but not when gestures preceded sound (audio lag). Participants thus compensated for delays of 1.5 seconds in either direction, apparently without making a conscious effort. This greatly exceeds the previously reported time window for automatic multimodal integration.

Publiceringsår

2015

Språk

Engelska

Sidor

19-23

Publikation/Tidskrift/Serie

Gesture and Speech in Interaction - 4th edition (GESPIN 4)

Dokumenttyp

Konferensbidrag

Ämne

  • Psychology

Nyckelord

  • gesture-speech synchronization
  • multimodal integration
  • temporal synchronization
  • comprehension

Conference name

Gesture and Speech in Interaction (GESPIN 4)

Conference date

2015-09-02 - 2015-09-04

Conference place

Nantes, France

Status

Published