中国科学院机构知识库网格
Chinese Academy of Sciences Institutional Repositories Grid
首页 机构 成果 学者
  
  1. CAS IR Grid
  2. 自动化研究所
  3. 中国科学院自动化研究所
  4. 多模态人工智能系统全国重点实验室
  5. 三维可视计算
Deep Facade Parsing with Occlusions

文献类型：期刊论文

作者Ma, Wenguang2; Ma, Wei2; Xu, Shibiao1
刊名KSII TRANSACTIONS ON INTERNET AND INFORMATION SYSTEMS
出版日期2022-02-28
卷号16期号:2页码:524-543
关键词Facade parsing occlusion repetitive pattern man-made structure
ISSN号1976-7277
DOI10.3837/tiis.2022.02.009
通讯作者Ma, Wei(mawei@bjut.edu.cn)
英文摘要Correct facade image parsing is essential to the semantic understanding of outdoor scenes. Unfortunately, there are often various occlusions in front of buildings, which fails many existing methods. In this paper, we propose an end-to-end deep network for facade parsing with occlusions. The network learns to decompose an input image into visible and invisible parts by occlusion reasoning. Then, a context aggregation module is proposed to collect nonlocal cues for semantic segmentation of the visible part. In addition, considering the regularity of man-made buildings, a repetitive pattern completion branch is designed to infer the contents in the invisible regions by referring to the visible part. Finally, the parsing map of the input facade image is generated by fusing the results of the visible and invisible results. Experiments on both synthetic and real datasets demonstrate that the proposed method outperforms state-of-the-art methods in parsing facades with occlusions. Moreover, we applied our method in applications of image inpainting and 3D semantic modeling.
WOS关键词WINDOW DETECTION ; SEGMENTATION
资助项目National Natural Science Foundation of China[62176010] ; National Natural Science Foundation of China[61771026] ; Open Project Program of the National Laboratory of Pattern Recognition (NLPR)
WOS研究方向Computer Science ; Telecommunications
语种英语
WOS记录号WOS:000767305400001
出版者KSII-KOR SOC INTERNET INFORMATION
资助机构National Natural Science Foundation of China ; Open Project Program of the National Laboratory of Pattern Recognition (NLPR)
源URL[http://ir.ia.ac.cn/handle/173211/48075]  
专题模式识别国家重点实验室_三维可视计算
通讯作者Ma, Wei
作者单位1.Chinese Acad Sci, Inst Automat, Natl Lab Pattern Recognit, Beijing 100190, Peoples R China
2.Beijing Univ Technol, Fac Informat Technol, Beijing 100124, Peoples R China
推荐引用方式
GB/T 7714		 Ma, Wenguang,Ma, Wei,Xu, Shibiao. Deep Facade Parsing with Occlusions[J]. KSII TRANSACTIONS ON INTERNET AND INFORMATION SYSTEMS,2022,16(2):524-543.
APA Ma, Wenguang,Ma, Wei,&Xu, Shibiao.(2022).Deep Facade Parsing with Occlusions.KSII TRANSACTIONS ON INTERNET AND INFORMATION SYSTEMS,16(2),524-543.
MLA Ma, Wenguang,et al."Deep Facade Parsing with Occlusions".KSII TRANSACTIONS ON INTERNET AND INFORMATION SYSTEMS 16.2(2022):524-543.

入库方式： OAI收割

来源：自动化研究所

浏览0
下载0
收藏0
其他版本

除非特别说明，本系统中所有内容都受版权保护，并保留所有权利。