中国科学院机构知识库网格
Chinese Academy of Sciences Institutional Repositories Grid
Causal Reasoning Meets Visual Representation Learning: A Prospective Study

文献类型:期刊论文

作者Yang Liu; Yu-Shen Wei; Hong Yan; Guan-Bin Li; Liang Lin
刊名Machine Intelligence Research
出版日期2022
卷号19期号:6页码:485-511
关键词Causal reasoning visual representation learning reliable artificial intelligence spatial-temporal data multi-modal analysis
ISSN号2731-538X
DOI10.1007/s11633-022-1362-z
英文摘要

Visual representation learning is ubiquitous in various real-world applications, including visual comprehension, video understanding, multi-modal analysis, human-computer interaction, and urban computing. Due to the emergence of huge amounts of multi modal heterogeneous spatial/temporal/spatial-temporal data in the big data era, the lack of interpretability, robustness, and out-of-distribution generalization are becoming the challenges of the existing visual models. The majority of the existing methods tend to fit the original data/variable distributions and ignore the essential causal relations behind the multi-modal knowledge, which lacks unified guidance and analysis about why modern visual representation learning methods easily collapse into data bias and have limited generalization and cognitive abilities. Inspired by the strong inference ability of human-level agents, recent years have therefore witnessed great effort in developing causal reasoning paradigms to realize robust representation and model learning with good cognitive ability. In this paper, we conduct a comprehensive review of existing causal reasoning methods for visual representation learning, covering fundamental theories, models, and datasets. The limitations of current methods and datasets are also discussed. Moreover, we propose some prospective challenges, opportunities, and future research directions for benchmarking causal reasoning algorithms in visual representation learning. This paper aims to provide a comprehensive overview of this emerging field, attract attention, encourage discussions, bring to the forefront the urgency of developing novel causal reasoning methods, publicly available benchmarks, and consensus-building standards for reliable visual representation learning and related real-world applications more efficiently.

源URL[http://ir.ia.ac.cn/handle/173211/55958]  
专题自动化研究所_学术期刊_International Journal of Automation and Computing
作者单位School of Computer Science and Engineering, Sun Yat-sen University, Guangzhou 510006, China
推荐引用方式
GB/T 7714
Yang Liu,Yu-Shen Wei,Hong Yan,et al. Causal Reasoning Meets Visual Representation Learning: A Prospective Study[J]. Machine Intelligence Research,2022,19(6):485-511.
APA Yang Liu,Yu-Shen Wei,Hong Yan,Guan-Bin Li,&Liang Lin.(2022).Causal Reasoning Meets Visual Representation Learning: A Prospective Study.Machine Intelligence Research,19(6),485-511.
MLA Yang Liu,et al."Causal Reasoning Meets Visual Representation Learning: A Prospective Study".Machine Intelligence Research 19.6(2022):485-511.

入库方式: OAI收割

来源:自动化研究所

浏览0
下载0
收藏0
其他版本

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。