Dynamics of pitch perception in the auditory cortex

  1. Laura Gwilliams6
  1. 1New York University; Department of Psychology
  2. 2Center for Language, Music, and Emotion (CLaME), New York University
  3. 3Music and Audio Research Laboratory (MARL), New York University
  4. 4New York University; Department of Linguistics
  5. 5Stanford University; Department of Statistics
  6. 6Stanford University; Department of Psychology
  1. ↵*Correspondence should be addressed to Ellie Bean Abrams at ellie.abrams{at}nyu.edu
  1. Author contributions: E.A. and L.G. designed research; E.A. and L.G. performed research; E.A., I.K., and L.G. analyzed data; E.A. wrote the first draft of the paper; E.A., A.M., I.K., and L.G. edited the paper; E.A. and L.G. wrote the paper.

Abstract

The ability to perceive pitch allows human listeners to experience music, recognize the identity and emotion conveyed by conversational partners, and make sense of their auditory environment. A pitch percept is formed by weighting different acoustic cues (e.g., signal fundamental frequency and inter-harmonic spacing) and contextual cues (expectation). How and when such cues are neurally encoded and integrated remains debated. In this study, twenty-eight participants (16 female) listened to tone sequences with different acoustic cues (pure tones, complex missing fundamental tones, and tones with an ambiguous mixture), placed in predictable and less predictable sequences, while magnetoencephalography was recorded. Decoding analyses revealed that pitch was encoded in neural responses to all three tone types, in the low-to-mid auditory cortex and sensorimotor cortex bilaterally, with right-hemisphere dominance. The pattern of activity generalized across cue-types, offset in time: pitch was neurally encoded earlier for harmonic tones (∼85ms) than pure tones (∼95ms). For ambiguous tones, pitch emerged significantly earlier in predictable contexts than unpredictable. The results suggest that a unified neural representation of pitch emerges by integrating independent pitch cues, and that context alters the dynamics of pitch generation when acoustic cues are ambiguous.

Significance Statement Pitch enables humans to enjoy music, understand the emotional intent of a conversational partner, distinguish lexical items in tonal languages, and make sense of the acoustic environment. The study of pitch has lasted over a century, with conflicting accounts of how and when the brain integrates spectrotemporal information to map different sound sources onto a single and stable pitch percept. Our results answer crucial questions about the emergence of perceptual pitch in the brain: namely, that place and temporal cues to pitch seem to be accounted for by early auditory cortex, that a common representation of perceptual pitch emerges early in the right hemisphere, and that the temporal dynamics of pitch representations are modulated by expectation.

Footnotes

  • The authors thank Ben Lang for help with data collection. We are very grateful to Pablo Ripollés and David Poeppel, and Bob Slevc for their feedback on this manuscript. This project received funding from the Abu Dhabi Research Institute G1001 (awarded to AM); BRAIN Foundation A-0741551370 (LG); Whitehall Foundation 2024-08-043 (LG)

  • The authors declare no competing financial interests.

  • Received June 10, 2024.
  • Revision received January 16, 2025.
  • Accepted January 22, 2025.