Neural Dynamics of the Processing of Speech Features: Evidence for a Progression of Features from Acoustic to Sentential Processing
- I. M. Dushyanthi Karunathilake1,
- Christian Brodbeck2,
- Shohini Bhattasali3,
- Philip Resnik4, and
- Jonathan Z. Simon1,5,6
- 1Department of Electrical and Computer Engineering, University of Maryland, College Park, Maryland 20742
- 2Department of Computing and Software, McMaster University, Hamilton, Ontario L8S 4L8, Canada
- 3Department of Language Studies, University of Toronto, Scarborough, Ontario M1C 1A4, Canada
- 4Departments of Linguistics and Institute for Advanced Computer Studies, College Park, Maryland, 20742
- 5Biology, University of Maryland, College Park, Maryland, 20742
- 6Institute for Systems Research, University of Maryland, College Park, Maryland 20742
-
Author contributions: I.M.D.K., C.B., S.B., P.R., and J.Z.S. designed research; I.M.D.K. performed research; I.M.D.K., C.B., S.B., P.R., and J.Z.S. analyzed data; I.M.D.K., C.B., S.B., P.R., and J.Z.S. wrote the paper.
Abstract
When we listen to speech, our brain’s neurophysiological responses “track” its acoustic features, but it is less well understood how these auditory responses are enhanced by linguistic content. Here, we recorded magnetoencephalography responses while subjects of both sexes listened to four types of continuous speechlike passages: speech envelope–modulated noise, English-like nonwords, scrambled words, and a narrative passage. Temporal response function (TRF) analysis provides strong neural evidence for the emergent features of speech processing in the cortex, from acoustics to higher-level linguistics, as incremental steps in neural speech processing. Critically, we show a stepwise hierarchical progression of progressively higher-order features over time, reflected in both bottom-up (early) and top-down (late) processing stages. Linguistically driven top-down mechanisms take the form of late N400-like responses, suggesting a central role of predictive coding mechanisms at multiple levels. As expected, the neural processing of lower-level acoustic feature responses is bilateral or right lateralized, with left lateralization emerging only for lexicosemantic features. Finally, our results identify potential neural markers, linguistic-level late responses, derived from TRF components modulated by linguistic content, suggesting that these markers are indicative of speech comprehension rather than mere speech perception.
- Received June 17, 2024.
- Revision received December 30, 2024.
- Accepted January 3, 2025.
- Copyright © 2025 the authors





