言语理解中音、形、义的预测加工及工作记忆的调控
文献类型：学位论文
| 作者 | 李欣晶 |
| 答辩日期 | 2022-06 |
| 文献子类 | 硕士 |
| 授予单位 | 中国科学院大学 |
| 授予地点 | 中国科学院心理研究所 |
| 其他责任者 | 屈青青 ; 李兴珊 |
| 关键词 | 语音预测 字形预测 语义预测 视觉情境范式 工作记忆 |
| 学位名称 | 理学硕士 |
| 学位专业 | 基础心理学 |
| 其他题名 | Phonological, Orthographic, and Semantic Prediction in Spoken Sentence Comprehension and the Modulation of Working Memory Capacity |
| 中文摘要 | According to the current situation and linguistic information, predicting the upcoming information is an important cognitive intelligence of human beings. The internal working mechanism and neural mechanism of prediction have been the core hot issues in psychology, cognitive science, and cognitive neuroscience. At present, research on the content of prediction reveals that there is a pre-activation of conceptual and syntactic representations during language comprehension. However, the pre-activation of phonological and orthographic features is controversial, and the important reason is that: Existing findings on word form prediction (i.e., phonological and orthographic prediction) come largely from studies conducted with languages with alphabetic scripts, making it difficult to dissociate the effects of phonology and orthography. Therefore, it is difficult to investigate the pre-activation of phonology and orthography independently. Moreover, most of the previous research focused on the mechanism of prediction processing itself, but little was known about the cognitive regulation mechanism of prediction. Clarifying these key problems is a necessary step in the comprehensive analysis of linguistic prediction processing. Therefore, using Chinese as the target language, the present study examined different levels of prediction (semantic, phonology, and orthography) and the modulation of linguistic prediction by working memory in spoken comprehension using eye-tracking technology and the visual world paradigm. In Study 1, we used the visual world paradigm to investigate whether comprehenders predict semantic, phonological, and orthography information during comprehension of Chinese sentences, where phonology and orthography are largely dissociable. In Experiment 1, participants listened to sentences containing a highly predictable word while viewing a visual display consisting of a critical object and three distractors (target object, a semantic competitor object, a phonological competitor object, or an unrelated object). Results showed participants fixated more on the semantic competitors and phonological competitors than on unrelated objects. More importantly, the fixation preference began before the participants heard the target word. The results showed that the semantic and phonological features of the spoken target word were pre-activated before the onset of the spoken target word. In Experiment 2, we verified the repeatability of the research results by manipulating preview time (2 s in Experiment 1 and 1 s in Experiment 2) and using a new set of stimuli. The results repeated anticipatory fixations on phonological competitor objects. In Experiment 3, we conducted a printed-word vision of the visual world paradigm to further verify the robustness of the phonological prediction and explore the pre-activation of orthographic information. We repeated the phonological prediction effect but did not find anticipatory fixations on orthographic competitor words. In Study 2, we investigated how working memory capacity (WMC) modulates different kinds of prediction behavior, i.e., semantic prediction and phonological prediction, in the visual world, which provide insights into the role of general cognitive processing in linguistic prediction. All aspects of Experiment 4 were the same as those of Experiment 1, except that we conducted a Chinese version of the Reading Span task to measure the working memory capacity and grouped participants into high and low WMC groups. We found anticipatory fixations to semantic and phonological features in the predictive time window. Moreover, we found that high WMC speakers are more likely and earlier to have anticipatory fixations on semantic and phonological features than low WMC speakers. This study reveals the modulatory mechanism of working memory capacity on semantic and phonological prediction effects. In summary, we demonstrated that listeners can predict not only semantic features of predictable words but also more specific phonological information during spoken sentence comprehension. We did not find the pre-activation of orthographic features during spoken comprehension. We also found that verbal working memory modulates semantic and phonological prediction in spoken comprehension. Specifically, the higher the working memory capacity, the larger and earlier the semantic and phonological prediction effects. This study deepens the understanding of the prediction content and processing mechanism and provides scientific evidence for the construction of a more complete language understanding model. It also provides important implications for natural language processing and language-like brain intelligence. |
| 英文摘要 | 根据当前情境和言语信息，对将要出现的信息进行预测是人类重要的认知智能。预测的内部工作机制和神经机制是心理学、认知科学及认知神经科学等领域的核心热点问题，近年来广受关注。目前，关于预测内容的研究揭示言语理解中存在对词汇语法、语义信息的预激活。但是，关于语音、字形特征的预激活争议较大，其重要原因在于：目前研究基本来自字母语言，很难分离语音和字形信息，从而很难独立考察语音、字形的预激活。另外，以往研究大多关注预测加工本身的机制，对预测的认知调控机制知之甚少。澄清这些关键问题是全面解析语言预测加工的必要一环。因此，本研究依托汉语作为实验目标语言，采用眼动追踪技术和视觉情境范式，考察言语理解中的不同层级（语音、字形、语义）的预测加工、以及工作记忆对不同层级预测加工的调控。 研究一考察了汉语言语理解中是否存在语音、字形、语义预测。实验一具体考察汉语言语理解中的语义和语音预测。实验采用视觉情境范式，被试听高限制性句子，句子中包含可预测的目标词；并观看屏幕上的图片刺激，图片刺激包含目标物、语义竞争项、语音竞争项、无关物四种条件。结果发现，与无关物相比，被试更多地注视语义竞争项、语音竞争项。更重要的是，这种注视偏好始于被试听到目标词之前。结果表明，被试在目标词呈现之前，预激活了目标词的语义、语音信息。实验二对该研究结果开展了重复性验证，采用更短的预视时长、新的实验材料，结果重复了实验一的语音预测效应。实验三中采用文字版本的视觉情境范式，进一步验证语音预测效应，并考察字形预测。实验三重复了语音预测效应，并且未发现稳定的字形预测效应。 研究二考察了言语工作记忆容量对言语理解中不同层级预测的调节作用。实验四探究了不同工作记忆容量如何调节言语理解中的语义预测及语音预测效应。通过阅读广度任务，采用极端组法将被试分为高、低言语工作记忆两组。与实验一相同，实验四采用视觉情境范式，结果发现，在预测时间窗口内，两组被试均表现出对语义竞争项与语音竞争项的注视偏好；并且，在预测时间窗内，相比于低工作记忆组被试，高工作记忆组的注视偏好在程度上更明显、在时间进程上更早。该研究揭示了工作记忆容量对语义和语音预测效应的调节机制。 综上，本研究发现在言语理解过程中语音信息能够被预激活，未发现稳健的字形预测证据。此外，发现言语工作记忆调节语义和语音信息的预激活，具体而言，工作记忆容量越高，语义和语音预测效应越大且出现越早。本研究加深了对预测内容与加工机制的理解，将为构建更完整的语言理解模型提供科学证据，也可为自然语言处理和语言类脑智能提供重要启示。 |
| 语种 | 中文 |
| 源URL | [http://ir.psych.ac.cn/handle/311026/43124]  |
| 专题 | 心理研究所_认知与发展心理学研究室 |
| 推荐引用方式 GB/T 7714 | 李欣晶. 言语理解中音、形、义的预测加工及工作记忆的调控[D]. 中国科学院心理研究所. 中国科学院大学. 2022. |
入库方式： OAI收割
来源：心理研究所
浏览0
下载0
收藏0
其他版本
除非特别说明，本系统中所有内容都受版权保护，并保留所有权利。