+ All Categories
Home > Documents > Neural Rhythm Synchronizes With Imagined Acoustic Rhythm...

Neural Rhythm Synchronizes With Imagined Acoustic Rhythm...

Date post: 24-Oct-2020
Category:
Upload: others
View: 2 times
Download: 0 times
Share this document with a friend
1
3 6 9 12 15 18 21 24 27 30 33 ‘Real’ ‘Fill-in’ Subject number Neural Rhythm Synchronizes With Imagined Acoustic Rhythm Francisco Cervantes Constantino 1 , Jonathan Z. Simon 2,3,4 1 Program in Neuroscience and Cognitive Science, 2 Department of Electrical & Computer Engineering, 3 Department of Biology, 4 Institute for Systems Research University of Maryland, College Park Introduction Conclusions Results This work was funded by the National Institutes of Health (NIDCD R01 DC 008342, 014085). We thank support to FCC from the Mexican Consejo Nacional de Ciencia y Tecnología. The Computational Sensorimotor Systems Laboratory Detection of acoustic rhythm in noise and sustained neural rhythm associated with aSSR [1]Picton TW (2010) Human Auditory Evoked Potentials. San Diego: Plural Publishing, Inc. [2]Millman RE, et al. (2010) NeuroImage, 49(1):745–758 . [3]de Cheveigné A & Simon JZ (2008) Journal of Neuroscience Methods, 171(1):331–339 . [4]Maris E & Oostenveld R (2007) Journal of Neuroscience Methods, 164(1):177–190 . [5]Riecke L, et al. (2009) Neuron, 64(4): 550–561 . An auditory source tracking a low-rate sound modulation remains more active and synchronized to a target rhythm when it is perceived. Cortical responses from that source may oscillate at rate of absent but contextually plausible rhythmic stimuli, in cases where the absent rhythm is nonetheless perceived. This sustained, differential processing forms the basis for a potential decision variable, even observable at the single subject level. It may contribute to prediction of perceptual or behavioral outcome. Sound modulation rate studied (slow-theta range) corresponds to syllabic timescale of human speech – raising the question of the case for synchronization to imagined/inner speech and auditory hallucinations. Findings are at odds with proposals of auditory restoration based on suppression of slow-theta synchronization during illusory rhythms, as a mechanism for stable hearing in noisy environments [5] . Findings support the notion of dynamic interpolation from contextual information present in stimulus or present in ongoing neural rhythms; this may create an internal template that guides hearing in noisy environments. Power of sustained neural rhythm also relates to reported perception of rhythm Percept-specific divergent processing contributes to predictability of detection performance not stimulus difficulty Observable effects of neural processing during rhythmic perception at single subject level 1 2 Cortex is thought to generate internal models of incomplete sensory data, but the mechanisms are yet unresolved. One possibility is contextual interpolation, such as in perceptual filling-in illusions. In response to rhythmic sounds, auditory cortex track target rhythms as a steady-state response (aSSR ) [1] . We analyze aSSR disruptions following noise interruptions to rhythmic sound, in order to examine these disruptions when listeners incorrectly perceive an absent target rhythm in noise. Using magnetoencephalography (MEG) we observe neural oscillations time-locked to the missing acoustic rhythms, thus reflecting entirely endogenous neural processes. 4 3 Detection task. Following a brief training session, N = 35 subjects (10 female) with no known neurological disorder or metallic implants were asked to detect target 5 Hz rhythm for every probe. Report by button-press, post probe offset. Silent film presented simultaneously. Noise probe SNR matched to participant such that detection was moderately difficult. Acknowledgments Poster website: http://www.ece.umd.edu/~fcc/res/illassr.pdf References Sound stimulus. 1 hour of 5 Hz frequency- modulated (FM) narrowband carrier, 0.5 – 2 kHz range, 20% duty-cycle [2] . 420 rhythmic probes (R ) created by adding noise epochs (duration 1.24 s) to the main rhythmic sequence. ccebh.umd.edu Spatial filter reflecting most reproducible component of subject aSSR selected as basis for single virtual sensor. Time-frequency analysis of single trial data with Morlet wavelet corresponding to 5 Hz. Estimation of evoked 5 Hz power and sample-size-bias corrected inter-trial phase coherence. Statistical p-value results obtained through non-parametric permutation tests [4] . Signal processing. Recordings from a 157- channel whole-head KIT-MEG system (1 KHz sampling rate, 30 Hz low-pass filter). Environment and sensor noise estimated and removed. Data-driven spatial filters from a source separation model (DSS) [3] estimated per participant (diagram right), using data from main sound sequence (probes excluded). R2141 Enhancement of non-phase locked theta and beta rhythms during illusory episodes Methods 420 non-rhythmic probes (NR ) created in the same way as (R ), but with FM removed. Noise spectrally-matched to FM, with SNR between -4 and 4 dB. Neural responses to probes with 5 Hz rhythm (blue curves) are stronger at 5 Hz than responses to probes missing the rhythm (red curves), in both evoked power (left) and phase locking/ inter-trial phase coherence (ITPC) (right), averaged across all 35 subjects, beginning ~0.56 s post probe onset (green intervals, p<0.001). Black lines indicate probe edges. Correctly identified trials only. 95% confidence interval via bootstrap. Subject R2141 Neural responses to probes lacking the 5 Hz rhythm are stronger at 5 Hz if reported as containing the rhythm (lt-blue curves), versus correct identification (red curves), in evoked power (left) but not phase locking/inter-trial phase coherence (ITPC) (right), beginning ~0.6 s post probe onset (green interval, p<0.001). Averaged across 32 subjects with 5 false alarm trials. Non-rhythmic (NR) probes only. 95% confidence interval via bootstrap. Real Not real Trials per subject as statistical unit. Left: Significant (p<0.05) subject-wise divergences (curve area differences as in sections 1,2) in the ‘Real’ (Hits minus Correct Rejections) and ‘Fill-in’ (False Alarms minus CR) contrasts, in either 5 Hz power or ITPC (black and grey), or in both (black only). Right: A single subject 5 Hz aSSR before, during, and after Hit (blue) and False Alarm (lt-blue) probes suggests direct synchronization to perceived rhythm during illusory trials (cf. figure in Methods, bottom left). 5 Subject-wise divergences correlate with task sensitivity not stimulus condition. (A) Evoked power divergences in the ‘Real’ (Hits minus Correct Rejections, blue) and ‘Fill-in’ (False Alarms minus C.R., lt blue) contrasts both correlate with task sensitivity subject-wise as measured by d’ (p<0.001); linear regression accounts for al least 30% and 32% of variance in each contrast respectively. (B) Phase-locking divergences in the ‘Real’ (blue), but not ‘Fill-in’ (lt blue), contrast correlates with task sensitivity (p<0.05); linear regression accounts for at least 13% of variance in this contrast. None of the power (C) or phase-locking (D) contrasts were found to correlate with stimulus signal-to-noise ratio. Theta (~5 Hz) rhythms enhanced during rhythmic perception, real or illusory; beta (10-20 Hz) enhanced during illusory rhythm only. Top row: Power spectrograms before, during, and after (A) Hit, (B) Correct Rejection, and (C) False Alarm probes. Edge displays in (A) and (C) indicate spectrotemporal regions where ‘Real’ and ‘Illusion’ contrasts are significant (p<0.05). Bottom row: Phase-locking spectrograms before, during, and after (D) Hit probes, (E) Correct Rejections. Edge display in (D) indicates regions where ‘Real’ contrast is significant (p<0.05). Vertical lines indicate probe edges. (F) Significant regions as in (A) and (D) largely overlap in both ‘Real’ contrasts (power and PL) surroundingtarget 5 Hz frequency. (F) A significant power region as in (A) and (C) overlaps in both ‘Real’ and ‘Fill-in’ contrasts, surrounding target 5 Hz frequency; higher frequency rhythms are also enhanced for the latter contrast. All data is across subjects (N=35 or 32). Evoked power Phase locking Time from probe onset [s] Time from probe onset [s] 5 Hz power [dB] 5 Hz ITPC-squared Correct rejection False alarm 5 Hz power [dB] 5 Hz ITPC-squared Time from probe onset [s] Time from probe onset [s] Evoked power Correct rejection Hit Phase locking -10 -5 0 5 10 -6 -4 -2 0 2 4 6 Power divergence [dB!s] d’ score Power and sensitivity ‘Real’ (H minus CR) ‘Fill-in’ (FA minus CR) ρ=0.55 ρ=0.57 A -0.2 -0.1 0 0.1 0.2 -6 -4 -2 0 2 4 6 PL divergence [s] d’ score PL and sensitivity ‘Fill-in’ contrast ‘Real’ contrast ρ=0.37 B -4 -2 -1 0 1 2 4 -15 -10 -5 0 5 10 15 Power divergence [dB!s] Probe SNR Power and stimulus C -4 -2 -1 0 1 2 4 -0.2 -0.1 0 0.1 0.2 PL divergence [s] Probe SNR PL and stimulus D 6 A B E C D F G Frequency [Hz] Frequency [Hz] Time from probe onset [s] Time [s] Time [s] Time from probe onset [s] Power [dB] ITPC-squared Power and PL Power only Phase locking only ‘Real’ and ‘Illusion’ ‘Illusion’ only ‘Real’ only Hit evoked power Correct rejection evoked power False alarm evoked power Hit phase locking Correct rejection phase locking ‘Real’ contrasts Power contrasts Divergence significant in power or PL Divergence significant in power and PL DSS Permutation of MEG trials
Transcript
Page 1: Neural Rhythm Synchronizes With Imagined Acoustic Rhythm ...cansl.isr.umd.edu/simonlab/pubs/SAND2015.pdf · rhythmic perception at single subject level 1 2 Cortex is thought to generate

3 6 9 12 15 18 21 24 27 30 33

‘Rea

l’ ‘F

ill-in

Subject number

Neural Rhythm Synchronizes With Imagined Acoustic Rhythm Francisco Cervantes Constantino1, Jonathan Z. Simon2,3,4

1Program in Neuroscience and Cognitive Science, 2Department of Electrical & Computer Engineering, 3Department of Biology, 4Institute for Systems Research University of Maryland, College Park

Introduction

Conclusions

Results

This work was funded by the National Institutes of Health (NIDCD R01 DC 008342, 014085). We thank support to FCC from the Mexican Consejo Nacional de Ciencia y Tecnología.

The Computational Sensorimotor Systems Laboratory

Detection of acoustic rhythm in noise and sustained neural rhythm associated with aSSR

[1]Picton TW (2010) Human Auditory Evoked Potentials. San Diego: Plural Publishing, Inc.[2]Millman RE, et al. (2010) NeuroImage, 49(1):745–758.[3]de Cheveigné A & Simon JZ (2008) Journal of Neuroscience Methods, 171(1):331–339.[4]Maris E & Oostenveld R (2007) Journal of Neuroscience Methods, 164(1):177–190.[5]Riecke L, et al. (2009) Neuron, 64(4): 550–561.

An auditory source tracking a low-rate sound modulation remains more active and synchronized to a target rhythm when it is perceived.

Cortical responses from that source may oscillate at rate of absent but contextually plausible rhythmic stimuli, in cases where the absent rhythm is nonetheless perceived.

This sustained, differential processing forms the basis for a potential decision variable, even observable at the single subject level. It may contribute to prediction of perceptual or behavioral outcome.

Sound modulation rate studied (slow-theta range) corresponds to syllabic timescale of human speech – raising the question of the case for synchronization to imagined/inner speech and auditory hallucinations.

Findings are at odds with proposals of auditory restoration based on suppression of slow-theta synchronization during illusory rhythms, as a mechanism for stable hearing in noisy environments [5].

Findings support the notion of dynamic interpolation from contextual information present in stimulus or present in ongoing neural rhythms; this may create an internal template that guides hearing in noisy environments.

Power of sustained neural rhythm also relates to reported perception of rhythm

Percept-specific divergent processing contributes to predictability of detection performance not stimulus difficulty

Observable effects of neural processing during rhythmic perception at single subject level

1

2

Cortex is thought to generate internal models of incomplete sensory data, but the mechanisms are yet unresolved. One possibility is contextual interpolation, such as in perceptual filling-in illusions.

In response to rhythmic sounds, auditory cortex track target rhythms as a steady-state response (aSSR) [1]. We analyze aSSR disruptions following noise interruptions to rhythmic sound, in order to examine these disruptions when listeners incorrectly perceive an absent target rhythm in noise.

Using magnetoencephalography (MEG) we observe neural oscillations time-locked to the missing acoustic rhythms, thus reflecting entirely endogenous neural processes.

4

3

Detection task. Following a brief training session, N = 35 subjects (10 female) with no known neurological disorder or metallic implants were asked to detect target 5 Hz rhythm for every probe.

Report by button-press, post probe offset.

Silent film presented simultaneously.

Noise probe SNR matched to participant such that detection was moderately difficult.

Acknowledgments

Poster website: http://www.ece.umd.edu/~fcc/res/illassr.pdf

References

Sound stimulus. 1 hour of 5 Hz frequency-modulated (FM) narrowband carrier, 0.5 – 2 kHz range, 20% duty-cycle [2].

420 rhythmic probes (R) created by adding noise epochs (duration 1.24 s) to the main rhythmic sequence.

ccebh.umd.edu

Spatial filter reflecting most reproducible component of subject aSSR selected as basis for single virtual sensor.

Time-frequency analysis of single trial data with Morlet wavelet corresponding to 5 Hz.

Estimation of evoked 5 Hz power and sample-size-bias corrected inter-trial phase coherence.

Statistical p-value results obtained through non-parametric permutation tests [4].

Signal processing. Recordings from a 157-channel whole-head KIT-MEG system (1 KHz sampling rate, 30 Hz low-pass filter).

Environment and sensor noise estimated and removed.

Data-driven spatial filters from a source separation model (DSS) [3] estimated per participant (diagram right), using data from main sound sequence (probes excluded).

R2141

Enhancement of non-phase locked theta and beta rhythms during illusory episodes

Methods

420 non-rhythmic probes (NR) created in the same way as (R), but with FM removed.

Noise spectrally-matched to FM, with SNR between -4 and 4 dB.

Neural responses to probes with 5 Hz rhythm (blue curves) are stronger at 5 Hz than responses to probes missing the rhythm (red curves), in both evoked power (left) and phase locking/inter-trial phase coherence (ITPC) (right), averaged across all 35 subjects, beginning ~0.56 s post probe onset (green intervals, p<0.001). Black lines indicate probe edges. Correctly identified trials only. 95% confidence interval via bootstrap.

Subject R2141

Neural responses to probes lacking the 5 Hz rhythm are stronger at 5 Hz if reported as containing the rhythm (lt-blue curves), versus correct identification (red curves), in evoked power (left) but not phase locking/inter-trial phase coherence (ITPC) (right), beginning ~0.6 s post probe onset (green interval, p<0.001). Averaged across 32 subjects with ≥ 5 false alarm trials. Non-rhythmic (NR) probes only. 95% confidence interval via bootstrap.

�Real�

�Not real�

Trials per subject as statistical unit. Left: Significant (p<0.05) subject-wise divergences (curve area differences as in sections 1,2) in the ‘Real’ (Hits minus Correct Rejections) and ‘Fill-in’ (False Alarms minus CR) contrasts, in either 5 Hz power or ITPC (black and grey), or in both (black only). Right: A single subject 5 Hz aSSR before, during, and after Hit (blue) and False Alarm (lt-blue) probes suggests direct synchronization to perceived rhythm during illusory trials (cf. figure in Methods, bottom left).

5

Subject-wise divergences correlate with task sensitivity not stimulus condition. (A) Evoked power divergences in the ‘Real’ (Hits minus Correct Rejections, blue) and ‘Fill-in’ (False Alarms minus C.R., lt blue) contrasts both correlate with task sensitivity subject-wise as measured by d’ (p<0.001); linear regression accounts for al least 30% and 32% of variance in each contrast respectively. (B) Phase-locking divergences in the ‘Real’ (blue), but not ‘Fill-in’ (lt blue), contrast correlates with task sensitivity (p<0.05); linear regression accounts for at least 13% of variance in this contrast. None of the power (C) or phase-locking (D) contrasts were found to correlate with stimulus signal-to-noise ratio.

Theta (~5 Hz) rhythms enhanced during rhythmic perception, real or illusory; beta (10-20 Hz) enhanced during illusory rhythm only. Top row: Power spectrograms before, during, and after (A) Hit, (B) Correct Rejection, and (C) False Alarm probes. Edge displays in (A) and (C) indicate spectrotemporal regions where ‘Real’ and ‘Illusion’ contrasts are significant (p<0.05). Bottom row: Phase-locking spectrograms before, during, and after (D) Hit probes, (E) Correct Rejections. Edge display in (D) indicates regions where ‘Real’ contrast is significant (p<0.05). Vertical lines indicate probe edges. (F) Significant regions as in (A) and (D) largely overlap in both ‘Real’ contrasts (power and PL) surroundingtarget 5 Hz frequency. (F) A significant power region as in (A) and (C) overlaps in both ‘Real’ and ‘Fill-in’ contrasts, surrounding target 5 Hz frequency; higher frequency rhythms are also enhanced for the latter contrast. All data is across subjects (N=35 or 32).

Evoked power Phase locking

Time from probe onset [s] Time from probe onset [s]

5 H

z po

wer

[dB

]

5 H

z IT

PC

-squ

ared

Correct rejection False alarm

5 H

z po

wer

[dB

]

5 H

z IT

PC

-squ

ared

Time from probe onset [s] Time from probe onset [s]

Evoked power

Correct rejection Hit

Phase locking

-10 -5 0 5 10-6

-4

-2

0

2

4

6

Power divergence [dB!s]

d’ s

core

Power and sensitivity

‘Real’ (H minus CR) ‘Fill-in’ (FA minus CR) ρ=0.55 ρ=0.57

A

-0.2 -0.1 0 0.1 0.2-6

-4

-2

0

2

4

6

PL divergence [s]

d’ s

core

PL and sensitivity

‘Fill-in’ contrast ‘Real’ contrast ρ=0.37

B

-4 -2 -1 0 1 2 4

-15-10-5051015

Pow

er d

iver

genc

e [d

B!s

]

Probe SNR

Power and stimulus C

-4 -2 -1 0 1 2 4

-0.2

-0.1

0

0.1

0.2

PL

dive

rgen

ce [s

]

Probe SNR

PL and stimulus D

6

A B

E

C

D F G

Freq

uenc

y [H

z]

Freq

uenc

y [H

z]

Time from probe onset [s] Time [s] Time [s] Time from probe onset [s]

Pow

er [dB]

ITPC

-squared

Power and PL Power only Phase locking only

‘Real’ and ‘Illusion’ ‘Illusion’ only ‘Real’ only

Hit evoked power Correct rejection evoked power False alarm evoked power

Hit phase locking Correct rejection phase locking ‘Real’ contrasts Power contrasts

Divergence significant in power or PL Divergence significant in power and PL

DSS

Permutation of MEG trials

Recommended