Predictive Timing in Speech Perception and Production
Final Report Abstract
Speech constitutes fundamentally adaptive behavior, i.e. speakers start compensating within about 150ms to disturbances in their ongoing articulation, induced, for example, by experimental manipulations of the auditory feedback they receive in real time. Moreover, after only a few minutes of exposure to a consistent perturbation speakers start to update their stored sensorimotor representations so that changes in articulation are observed even when normal feedback is restored. The way speakers monitor their ongoing articulation has been extensively studied for spatial properties of articulation (i.e. they hear a different vowel from the one they intend to produce). However, speech exhibits structure in time as well as space; yet, very little is known about how the former aspect is monitored in ongoing speech. This project thus analyzed responses to temporal auditory feedback perturbation; typically, within a multisyllable utterance one sound was stretched and the following sound compressed in realtime. Interest focused firstly on how systematic variation of the location of the perturbation with respect to phonetic and linguistic properties of the utterance can modulate online monitoring and adaptive behavior. Secondly, participants with a wide range of sensorimotor abilities were recruited, including people who stutter, and musicians. All participants completed a test battery of general sensorimotor abilities. Thirdly, we have started to compare responses to perturbation of both speech and music production. The main results to date include the following: (1) stronger responses to perturbation in syllable onset vs. syllable coda, indicating a greater malleability of the coda position; (2) stronger (and also a qualitatively different pattern of) responses in stressed vs. unstressed syllables; (3) no evidence for stronger responses when the perturbation results in a change of lexical identity; (4) preliminary evidence that persons who stutter may differ from controls in how syllable location affects online processing; evidence that responses to perturbation at different syllable locations depend in different ways on the sensorimotor abilities of the participants (perception more relevant in onset position, motor stability more relevant in coda position); (6) in the music tasks (involving a short multisyllabic sung phrase) there was a surprisingly weak response to (temporal) perturbation of the rhythmic structure, but clear compensation across the whole phrase to pitch perturbation. As the longer-term goal, we now aim to integrate these individual results into an overall understanding of adaptive behavior at the intersection of perceptual sensitivity, motor stability and internal models of self-generated error.
Publications
-
Temporal perturbation of fluent speech. Laboratory Phonology 16, Lisbon.
Oschkinat, M. & Hoole, P.
-
Real-time auditory feedback perturbation of German quantity contrasts. The Journal of the Acoustical Society of America, 145(3_Supplement), 1914-1914.
Oschkinat, Miriam; Reinisch, Eva & Hoole, Philip
-
The effect of real-time temporal auditory feedback perturbation on the timing of syllable structure. In S. Calhoun, P. Escudero, M. Tabain & P. Warren (eds.) Proc. 19th Int. Cong. Phonetic Sciences (pp. 1848-1852). ISBN 978-0-646-80069-1
Oshkinat, M. & Hoole, P.
-
Adaptation to Temporal Auditory Feedback Perturbation and its Relation to general Motor Stability and Auditory Acuity. 12th International Seminar on Speech Production
Oschkinat, M., Hoole, P., Falk, F. & Dalla Bella, S.
-
Compensation to real-time temporal auditory feedback perturbation depends on syllable position. The Journal of the Acoustical Society of America, 148(3), 1478-1495.
Oschkinat, Miriam & Hoole, Philip
-
Abstracts of the 8th International Conference on Speech Motor Control Groningen, August 2022. Stem-, Spraak- en Taalpathologie, 27 Suppl..
SSTP, Redactie
-
Reactive feedback control and adaptation to perturbed speech timing in stressed and unstressed syllables. Journal of Phonetics, 91, 101133.
Oschkinat, Miriam & Hoole, Philip
-
Temporal malleability to auditory feedback perturbation is modulated by rhythmic abilities and auditory acuity. Frontiers in Human Neuroscience, 16.
Oschkinat, Miriam; Hoole, Philip; Falk, Simone & Dalla, Bella Simone
-
Different responses to perturbed speech timing between persons who stutter and fluent speakers depend on syllable position. Invited contribution to the Symposium Neural bases of speech production, UCSF, March 24, 2023
Oschkinat, M.
-
Different sensitivity to temporal auditory feedback perturbation in adults who stutter: syllable structure effects. In: R. Skarnitzl & J. Volín (Eds.), Proc. 20th Int. Cong. Phonetic Sciences (pp. 868–872). ISSN 2412-0669, ISBN 978-80-908 114-2-3
Oschkinat, M. & Hoole, P.
-
Monitoring speech timing via auditory feedback in French. Proc. 19th Conf. on Laboratory Phonology, pp. 437-438
Oschkinat, M., Benker, N., Hoole, P., Falk, S. & Dalla Bella, S.
-
Probing the impact of musical training on the temporal malleability of timing in French. 13th International Seminar on Speech Production, Autrans
Benker, N., Oschkinat, M., Hoole, P., Falk, S. & Dalla Bella, S.
