Causal Reasoning Meets Visual Representation Learning: A Prospective Study
文献类型:期刊论文
作者 | Yang Liu; Yu-Shen Wei; Hong Yan; Guan-Bin Li; Liang Lin |
刊名 | Machine Intelligence Research
![]() |
出版日期 | 2022 |
卷号 | 19期号:6页码:485-511 |
关键词 | Causal reasoning visual representation learning reliable artificial intelligence spatial-temporal data multi-modal analysis |
ISSN号 | 2731-538X |
DOI | 10.1007/s11633-022-1362-z |
英文摘要 | Visual representation learning is ubiquitous in various real-world applications, including visual comprehension, video understanding, multi-modal analysis, human-computer interaction, and urban computing. Due to the emergence of huge amounts of multi modal heterogeneous spatial/temporal/spatial-temporal data in the big data era, the lack of interpretability, robustness, and out-of-distribution generalization are becoming the challenges of the existing visual models. The majority of the existing methods tend to fit the original data/variable distributions and ignore the essential causal relations behind the multi-modal knowledge, which lacks unified guidance and analysis about why modern visual representation learning methods easily collapse into data bias and have limited generalization and cognitive abilities. Inspired by the strong inference ability of human-level agents, recent years have therefore witnessed great effort in developing causal reasoning paradigms to realize robust representation and model learning with good cognitive ability. In this paper, we conduct a comprehensive review of existing causal reasoning methods for visual representation learning, covering fundamental theories, models, and datasets. The limitations of current methods and datasets are also discussed. Moreover, we propose some prospective challenges, opportunities, and future research directions for benchmarking causal reasoning algorithms in visual representation learning. This paper aims to provide a comprehensive overview of this emerging field, attract attention, encourage discussions, bring to the forefront the urgency of developing novel causal reasoning methods, publicly available benchmarks, and consensus-building standards for reliable visual representation learning and related real-world applications more efficiently. |
源URL | [http://ir.ia.ac.cn/handle/173211/55958] ![]() |
专题 | 自动化研究所_学术期刊_International Journal of Automation and Computing |
作者单位 | School of Computer Science and Engineering, Sun Yat-sen University, Guangzhou 510006, China |
推荐引用方式 GB/T 7714 | Yang Liu,Yu-Shen Wei,Hong Yan,et al. Causal Reasoning Meets Visual Representation Learning: A Prospective Study[J]. Machine Intelligence Research,2022,19(6):485-511. |
APA | Yang Liu,Yu-Shen Wei,Hong Yan,Guan-Bin Li,&Liang Lin.(2022).Causal Reasoning Meets Visual Representation Learning: A Prospective Study.Machine Intelligence Research,19(6),485-511. |
MLA | Yang Liu,et al."Causal Reasoning Meets Visual Representation Learning: A Prospective Study".Machine Intelligence Research 19.6(2022):485-511. |
入库方式: OAI收割
来源:自动化研究所
其他版本
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。