中国科学院机构知识库网格
Chinese Academy of Sciences Institutional Repositories Grid
A Neurorobotic Experiment for Crossmodal Conflict Resolution in Complex Environments

文献类型:会议论文

作者German I. Parisi1; Pablo Barros1; Di Fu1,3,4; Sven Magg1; Haiyan Wu2,3,4; Xun Liu3,4; Stefan Wermter1
出版日期2019
会议日期OCT 01-05, 2018
会议地点Madrid, SPAIN
卷号2018
页码2330-2335
英文摘要

Crossmodal conflict resolution is a crucial component of robot sensorimotor coupling through interaction with the environment for swift and robust behaviour also in noisy conditions. In this paper, we propose a neurorobotic experiment in which an iCub robot exhibits human-like responses in a complex crossmodal environment. To better understand how humans deal with multisensory conflicts, we conducted a behavioural study exposing 33 subjects to congruent and incongruent dynamic audio-visual cues. In contrast to previous studies using simplified stimuli, we designed a scenario with four animated avatars and observed that the magnitude and extension of the visual bias are related to the semantics embedded in the scene, i.e., visual cues that are congruent with environmental statistics (moving lips and vocalization) induce a stronger bias. We propose a deep learning model that processes stereophonic sound, facial features, and body motion to trigger a discrete response resembling the collected behavioural data. After training, we exposed the iCub to the same experimental conditions as the human subjects, showing that the robot can replicate similar responses in real time. Our interdisciplinary work provides important insights into how crossmodal conflict resolution can be modelled in robots and introduces future research directions for the efficient combination of sensory drive with internally generated knowledge and expectations.

产权排序2
会议录2018 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS)
文献子类Article
语种英语
源URL[http://ir.psych.ac.cn/handle/311026/31308]  
专题心理研究所_中国科学院行为科学重点实验室
作者单位1.Knowledge Technology, Department of Informatics, Universit¨at Hamburg, Germany.
2.Division of the Humanities and Social Sciences, Caltech, CA, USA.
3.Department of Psychology, University of CAS, Beijing, China.
4.CAS Key Laboratory of Behavioral Science, Chinese Academy of Sciences (CAS), Beijing, China.
推荐引用方式
GB/T 7714
German I. Parisi,Pablo Barros,Di Fu,et al. A Neurorobotic Experiment for Crossmodal Conflict Resolution in Complex Environments[C]. 见:. Madrid, SPAIN. OCT 01-05, 2018.

入库方式: OAI收割

来源:心理研究所

浏览0
下载0
收藏0
其他版本

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。