视觉深度运动信息对声音运动方向感知的影响
文献类型：学位论文
| 作者 | 臧奋英 |
| 答辩日期 | 2022-06 |
| 文献子类 | 硕士 |
| 授予单位 | 中国科学院大学 |
| 授予地点 | 中国科学院心理研究所 |
| 其他责任者 | 禤宇明 |
| 关键词 | 深度信息 运动知觉 渐近偏差 多通道整合 |
| 学位名称 | 理学硕士 |
| 学位专业 | 基础心理学 |
| 其他题名 | The Influence of Visual Depth Cues on Discrimination of Auditory Motion |
| 中文摘要 | Looming motion in depth may signal approaching threats or collisions which need the subjects to react-fight or flight-immediately. On the contrary, the receding motion may indicate successful escape. Quick and accurate discrimination of these two kinds of motion quickly and accurately is important for animals’ survival. Both visual inputs and auditory inputs, such as size changes, loudness changes, are able to provide reliable information about looming motion and receding motion. Many unisensory studies have already found that there is a kind of asymmetry between the perception of looming and receding signals. That is to say, the looming events are more salient than receding ones in perception, which is called ‘the looming bias’. The looming bias can be seen in a lot of psychophysical tasks which are related to salience. However, no studies have examined whether the same looming bias also exists in cross-modal interaction. Based on the improved experimental materials, the current research explores the influence of visual depth information on the discrimination of auditory signals in depth systematically by designing behavioral experiments and EEG experiment. The first study contains three behavioral experiments, mainly focusing on the pattern of this cross-modal influence. To be specific, in the first experiment, we use different visual stimuli to explore how the discrimination of auditory motion is influenced by synchronous visual depth cues and whether there is a looming bias in this process. The results show that the congruency effect was larger in visual looming than visual receding condition. That means compared to the receding signals, visual looming signals are associated with a stronger influence on the discrimination of auditory motion in depth. The second experiment assessed the looming bias by using the psychophysical method. The results are consistent with the results of experiment one. In the third experiment, we manipulated the audio-visual synchronization to explore how synchronization modulates this cross-modal influence. Results show that when SOA equals zero, we can see the largest cross-modal influence, that is to say, when presented synchronously, the visual information will have the largest influence on the discrimination of auditory motion direction. And to some extent, this result can also indicate that the results of experiments one and two are due to multisensory integration, not caused by semantic priming and reaction bias. In the second study, we explored the brain mechanism: at which stage of perceptual decision-making does this cross-modal influence occur? We found that the congruent effect is related to semantic interactions and this cross-modal influence may occur in the decision formation stage. Generally speaking, the current research found looming bias is widespread, which can help us to understand the characteristics of motion perception in depth. Our research explored how the motion signals from different modalities interact with each other at different processing stages, which provides evidence from depth dimension for those multisensory integration hypotheses. |
| 英文摘要 | 深度维度的渐近、渐远运动信息分别预示着物体的靠近和远离，对这两类运动快速准确的探测和辨别对于生物的生存至关重要。视觉和听觉通道都可以提供关于深度运动的可靠信息。迄今为止，已经有很多多感觉的研究考察了水平、垂直运动的知觉过程，而考察不同感觉通道的深度运动信息相互作用的研究相对较少，已有相关研究尚未系统地考察视觉深度信息对于声音运动方向感知的影响及其加工过程。以往研究表明，生物对渐近信息具有更强的知觉敏感性和认知偏好，表现出“渐近偏差”，尚未有研究考察跨通道影响中是否同样存在渐近偏差。 本研究使用扩张、收缩运动的圆形光栅分别模拟视觉渐近、渐远运动，使用响度线性增大、减小的复合音分别表示听觉渐近、渐远运动；采用行为实验和事件相关电位技术，较为系统地考察了视觉深度信息对于声音运动方向辨别的影响及其时间加工进程。 研究一探究视觉深度信息对声音运动方向辨别的影响及其表现形式。实验 1基于声音运动方向辨别任务，通过分别呈现单通道听觉刺激或运动方向一致/不一致的视听刺激来考察视觉深度运动信息对声音运动方向辨别的影响及其表现形式，初步探索“视对听的跨通道影响是否存在渐近偏差”这一问题。结果表明，同步呈现运动方向一致的视觉信息会提高声音运动方向辨别任务的绩效，不一致的视觉信息会降低任务绩效，且存在渐近偏差。实验 2 基于心理物理法，进一步量化了视觉深度渐近、渐远信息对声音运动方向感知的影响差异。实验 3 通过改变视听信息呈现的同步性，探究视听同步性对声音深度运动感知中跨通道影响的调节。结果发现在视听刺激同步呈现时，跨通道影响程度最大，这也在一定程度上表明这一过程中发生了多感觉整合。研究二采用事件相关电位技术考察视觉深度信息影响声音运动方向感知的时间进程，结果表明深度运动方向辨别中表现出的多通道一致性效应受到 N4 成分的支持，表明这种跨通道影响可能发生在知觉决策的决策形成阶段。 本研究揭示了跨通道的视觉深度运动信息影响声音深度运动方向辨别的表 现形式，还发现这种跨通道影响也存在渐近偏差，有助于加深我们对深度维度运动知觉特点的认识；考察了这一跨通道影响的时间加工进程，可以帮助我们更深入地理解深度维度的知觉加工机制。 |
| 语种 | 中文 |
| 源URL | [http://ir.psych.ac.cn/handle/311026/43142]  |
| 专题 | 心理研究所_认知与发展心理学研究室 |
| 推荐引用方式 GB/T 7714 | 臧奋英. 视觉深度运动信息对声音运动方向感知的影响[D]. 中国科学院心理研究所. 中国科学院大学. 2022. |
入库方式： OAI收割
来源：心理研究所
浏览0
下载0
收藏0
其他版本
除非特别说明，本系统中所有内容都受版权保护，并保留所有权利。