音乐层级结构在线加工的认知神经机制
文献类型：学位论文
| 作者 | 吴伊扬
|
| 答辩日期 | 2024-06 |
| 文献子类 | 博士 |
| 授予单位 | 中国科学院大学 |
| 授予地点 | 中国科学院心理研究所 |
| 其他责任者 | 杜忆 |
| 关键词 | 音乐层级结构 神经跟踪响应 眼动 感觉运动同步 |
| 学位名称 | 理学博士 |
| 学位专业 | 基础心理学 |
| 其他题名 | The Cognitive Neural Mechanisms of Online Processing of Musical Hierarchical Structure |
| 中文摘要 | Continuous musical stream, like language, is a hierarchically structured sequence in which discrete elements are organized according to syntactic principles. To what degree can listeners process and understand the meaning of music depends on their perception of musical hierarchical structures. Previous studies in neuroscience have shown that neural oscillation track hierarchical structures in language and music, and motor system, specifically eye movement, plays an important role in hierarchical processing in language. However, how does the brain track dynamic music information, especially the neural mechanism of segmenting pieces of music into meaningful units or establishing high-level music structures online is not yet clear. Likewise, while it has been established that the motor cortex is involved in the perception of musical rhythm, it remains unclear how it contributes to the encoding of continuous musical streams, particularly in terms of processing hierarchical structures in music. This thesis aims to address this gap by examining the online processing of musical hierarchical structure during natural music listening. Through two studies consisted of five experiments, this thesis integrated electroencephalography, eye tracking, diffusion tensor imaging, and other techniques to investigate the cognitive neural mechanisms of online processing of musical hierarchical structure. Study 1 utilized electroencephalography and eye-tracking to explore the cognitive neural mechanisms of online processing of musical hierarchical structure through three experiments. Experiment 1 selected ten musical pieces from Bach's chorales and created reverse version by completely reversing the order of beats in each original piece to manipulate the harmonic progression in reverse condition. Non-musician subjects were instructed to listen to the music three times consecutively undergoing EEG recording to examine how individuals process and segment musical hierarchical structures online and the effects of repeated listening. The results demonstrated that for the low-level structure in music, low-frequency neural oscillation tracked musical beats and notes, and were modulated by repeated listening. For the high-level structure, ultralow frequency neural oscillation tracked musical phrases and the anticipation of phrase boundaries was influenced by harmonic progression and individual prior knowledge. Experiment 2, employing the same task, investigated how the motor system (eye movement) was engaged in processing hierarchical structures of music. Surprisingly, the results revealed that blinking activity could synchronize with the musical beats and demonstrated anticipation of beat occurrence. The mutual information between blink activity and neural signals was affected by harmonic progression and repeated listening, and the EEG signals could predict when blinks would occur. Experiment 3 further explored the influencing factors and mechanism of blink tracking response through three sub-experiments. The findings indicated that the blink tracking was robustly to musical rhythm. Its response amplitude positively predicted cognitive performance in a pitch deviant detection task and was inhibited by visual target detection task. This study shed light on the cognitive neural mechanisms of online processing of musical hierarchical structure from both sensory and motor perspectives. Study 2 employed electroencephalography and diffusion tensor imaging techniques to investigate the brain's structural basis involved in the online processing of musical hierarchical structure through two experiments. Experiment 4 combined EEG recording with individual brain structure images to explore the brain areas involved in the online processing of musical hierarchical structure. The results demonstrated that neural tracking of musical low-level hierarchical structures activated right posterior superior temporal gyrus and the bilateral supplementary motor area, while neural tracking of high-level hierarchical structures activated the right posterior superior temporal gyrus, inferior parietal lobule, prefrontal cortex, and the left supplementary motor area. Experiment 5 employed diffusion tensor imaging and neurite orientation dispersion and density imaging techniques to reconstruct the four branches of the superior longitudinal fasciculus. Different white matter structural connectivity indicators were calculated, and their correlation with neural and blink tracking response amplitude were analyzed to explore the basis of structural connectivity in the brain involved in the online processing of hierarchical structures in music. The results indicated that the white matter microstructure properties of dorsal and posterior branches of the superior longitudinal fasciculus were significantly associated with the neural tracking and blink tracking response amplitude of musical beats. Furthermore, the developmental status of the left and right brains and the lateralization index between them both could predict the neural tracking and blink tracking response amplitude of musical beats during natural music listening. In summary, this thesis advances our understanding of the cognitive neural mechanisms of online processing of musical hierarchical structure by utilizing music stimuli with high ecological validity. From a sensory perspective, it reveals that in addition to processing low-level musical structures through low frequency neural oscillation, brain can also process and represent high-level musical structures through ultra-low frequency neural oscillation. From a motor perspective, it broadens our understanding of the online processing of musical hierarchical structure. The motor system (eye blink), alongside the sensory system, is involved in the online processing of continuous music stream and representation of hierarchically organized musical structures. From a structural perspective, it enriches our understanding of the online processing of musical hierarchical structure by uncovering the brain areas and the basis of structural connectivity that underlie it. The findings of this thesis deepen our comprehension of the cognitive neural mechanisms of online processing of musical hierarchical structure, and offer new insights and possibilities for the application of music in clinical, educational, and health intervention fields. |
| 英文摘要 | 与语言一样，连续的音乐片段中也存在明确的层级结构规则。听者在聆听音 乐的过程中如何感知并划分层级结构，影响了他们对音乐作品的加工和理解。前 人研究表明，大脑可以利用神经振荡切分语音或音乐序列的层级结构，且运动系 统（如眼部活动）会参与对语言层级结构的加工。然而，目前有关大脑神经振荡 如何表征音乐序列中的层级结构的研究还相对较少，且主要集中在较低层级的结 构单元，如音乐的拍子或节拍。此外，尽管已证实运动皮层参与音乐节奏知觉， 但尚不清楚其如何在线加工连续音乐流的层级结构。本论文结合脑电图、眼动跟 踪和弥散张量成像等技术，通过两项研究（五个实验），探究了自然音乐聆听过 程中音乐层级结构在线加工的认知神经机制及其脑结构基础。 研究一使用脑电图和眼动跟踪技术，通过三个实验探究了音乐层级结构在线 加工的认知神经机制。实验一利用脑电图技术，让非音乐家被试反复聆听（三遍） 巴赫众赞歌选段或其倒转版本（破坏调性和声进行结构），以考察神经振荡在音 乐层级结构在线加工中的作用。结果发现，大脑对低层级结构（音符和拍子）的 神经跟踪响应通过低频神经振荡产生，并受重复聆听调节；对高层级结构（乐句）， 大脑则通过超低频神经振荡在线跟踪乐句，其对乐句边界的预期受和声进行典型 性与个体先验知识的影响。实验二通过相同的任务，结合脑电图与眼动跟踪技术， 考察运动系统（眼部活动）在音乐层级结构在线加工中的作用。结果原创性地发 现，眨眼活动会同步于音乐的拍子，且显示出对拍子出现时间的预期。同时，眨 眼活动与脑电对应频率能量的互信息受到和声进行典型性和重复聆听的影响，且 脑电信号可以预测眨眼的发生。实验三通过三个子实验，进一步探究了眨眼跟踪 响应的影响因素和作用机制。结果发现，眨眼跟踪响应不受音乐速度或旋律存在 与否的影响（实验三 a），其响应强度能正向预测音乐拍点上的音高偏差刺激的 识别正确率（实验三 b），且受到视觉探测任务的抑制（实验三 c）。该研究从 感觉和运动两个角度揭示了音乐层级结构在线加工有关的认知神经机制。 研究二使用脑电图和弥散张量成像技术，通过两个实验探究了音乐层级结构 在线加工的脑结构基础。实验四使用磁共振结构像引导的脑电溯源分析，发现对 音乐低层级结构的神经跟踪激活了右侧颞上回后部和双侧辅助运动区，而对高层 级结构的神经跟踪激活了右侧颞上回后部、顶下小叶、前额叶皮层，以及左侧辅 助运动区。实验五则通过弥散张量成像和神经突方向离散度和密度成像技术重建 上纵束的四条白质纤维束分支，计算不同的白质连接指标并与神经和眨眼跟踪响 应幅值进行相关分析，探究音乐层级结构在线加工的脑结构连接基础。结果发现， 背侧上纵束及后侧上纵束分支与音乐拍子的神经跟踪响应和眨眼跟踪响应幅值显著相关。无论是其左右脑各自的发育状态，或是两脑间的发育偏侧化指数都能 预测在音乐聆听过程中对拍子的神经跟踪和眨眼跟踪幅值。 综上所述，本论文使用高生态效度的自然音乐，在感觉角度上加深了对音乐 层级结构在线加工的理解，发现大脑在利用低频神经振荡加工低层级音乐结构的 同时，还能通过超低频神经振荡加工并表征高层级音乐结构；在运动角度上拓宽 了对音乐层级结构在线加工的理解，除感觉系统外，运动系统（眼动）也参与了 对连续音乐流的在线加工和层级结构的表征过程；在结构角度上丰富了对音乐层 级结构在线加工的理解，揭露了其背后涉及的脑区和结构连接基础。本论文的发 现深化了对音乐层级结构在线加工认知神经机制的认识，为音乐在临床、教育或 健康干预领域的应用提供了新的工具和思路。 |
| 语种 | 中文 |
| 源URL | [http://ir.psych.ac.cn/handle/311026/48010]  |
| 专题 | 心理研究所_认知与发展心理学研究室 |
| 推荐引用方式 GB/T 7714 | 吴伊扬. 音乐层级结构在线加工的认知神经机制[D]. 中国科学院心理研究所. 中国科学院大学. 2024. |
入库方式： OAI收割
来源：心理研究所
浏览0
下载0
收藏0
其他版本
除非特别说明，本系统中所有内容都受版权保护，并保留所有权利。