Statistical Analysis of Multisensory and Text-Derived Representations on Concept Learning
文献类型：期刊论文
| 作者 | Wang, Yuwei3,4 ; Zeng, Yi1,2,3,4
|
| 刊名 | FRONTIERS IN COMPUTATIONAL NEUROSCIENCE
 |
| 出版日期 | 2022-04-27 |
| 卷号 | 16页码:12 |
| 关键词 | concept learning multisensory representations text-derived representations representational similarity analysis concreteness |
| DOI | 10.3389/fncom.2022.861265 |
| 通讯作者 | Zeng, Yi(yi.zeng@ia.ac.cn) |
| 英文摘要 | When learning concepts, cognitive psychology research has revealed that there are two types of concept representations in the human brain: language-derived codes and sensory-derived codes. For the objective of human-like artificial intelligence, we expect to provide multisensory and text-derived representations for concepts in AI systems. Psychologists and computer scientists have published lots of datasets for the two kinds of representations, but as far as we know, no systematic work exits to analyze them together. We do a statistical study on them in this work. We want to know if multisensory vectors and text-derived vectors reflect conceptual understanding and if they are complementary in terms of cognition. Four experiments are presented in this work, all focused on multisensory representations labeled by psychologists and text-derived representations generated by computer scientists for concept learning, and the results demonstrate that (1) for the same concept, both forms of representations can properly reflect the concept, but (2) the representational similarity analysis findings reveal that the two types of representations are significantly different, (3) as the concreteness of the concept grows larger, the multisensory representation of the concept becomes closer to human beings than the text-derived representation, and (4) we verified that combining the two improves the concept representation. |
| WOS关键词 | MODALITY EXCLUSIVITY NORMS ; PERCEPTUAL EXPERIENCE ; RATINGS ; SPEECH ; WORDS ; NOUNS ; SET |
| WOS研究方向 | Mathematical & Computational Biology ; Neurosciences & Neurology |
| 语种 | 英语 |
| WOS记录号 | WOS:000798956600001 |
| 出版者 | FRONTIERS MEDIA SA |
| 源URL | [http://ir.ia.ac.cn/handle/173211/49455]  |
| 专题 | 类脑智能研究中心_类脑认知计算 |
| 通讯作者 | Zeng, Yi |
| 作者单位 | 1.Chinese Acad Sci, Inst Automat, Natl Lab Pattern Recognit, Beijing, Peoples R China 2.Chinese Acad Sci, Ctr Excellence Brain Sci & Intelligence Technol, Shanghai, Peoples R China 3.Univ Chinese Acad Sci, Sch Artificial Intelligence, Beijing, Peoples R China 4.Chinese Acad Sci, Inst Automat, Res Ctr Brain Inspired Intelligence, Beijing, Peoples R China |
| 推荐引用方式 GB/T 7714 | Wang, Yuwei,Zeng, Yi. Statistical Analysis of Multisensory and Text-Derived Representations on Concept Learning[J]. FRONTIERS IN COMPUTATIONAL NEUROSCIENCE,2022,16:12. |
| APA | Wang, Yuwei,&Zeng, Yi.(2022).Statistical Analysis of Multisensory and Text-Derived Representations on Concept Learning.FRONTIERS IN COMPUTATIONAL NEUROSCIENCE,16,12. |
| MLA | Wang, Yuwei,et al."Statistical Analysis of Multisensory and Text-Derived Representations on Concept Learning".FRONTIERS IN COMPUTATIONAL NEUROSCIENCE 16(2022):12. |
入库方式： OAI收割
来源：自动化研究所
浏览0
下载0
收藏0
其他版本
除非特别说明，本系统中所有内容都受版权保护，并保留所有权利。