Self-Supervised Monocular Depth Estimation With Geometric Prior and Pixel-Level Sensitivity
文献类型：期刊论文
| 作者 | Liu, Jierui2,3 ; Cao, Zhiqiang2,3; Liu, Xilong2,3; Wang, Shuo2,3; Yu, Junzhi1
|
| 刊名 | IEEE TRANSACTIONS ON INTELLIGENT VEHICLES
 |
| 出版日期 | 2023-03-01 |
| 卷号 | 8期号:3页码:2244-2256 |
| ISSN号 | 2379-8858 |
| 关键词 | Estimation Costs Training Sensitivity Cameras Optical flow Semantics Monocular depth estimation self-supervised learning prior feature consistency sensitivity adaptation |
| DOI | 10.1109/TIV.2022.3210274 |
| 通讯作者 | Liu, Xilong(xilong.liu@ia.ac.cn) |
| 英文摘要 | Self-supervised monocular depth estimation has gained popularity due to its convenience of training network without dense ground truth depth annotation. Specifically, the multi-frame monocular depth estimation achieves promising results in virtue of temporal information. However, existing multi-frame solutions ignore the different impacts of pixels of input frame on depth estimation and the geometric information is still insufficiently explored. In this paper, a self-supervised monocular depth estimation framework with geometric prior and pixel-level sensitivity is proposed. Geometric constraint is involved through a geometric pose estimator with prior depth predictor and optical flow predictor. Further, an alternative learning strategy is designed to improve the learning of prior depth predictor by decoupling it with the ego-motion from the geometric pose estimator. On this basis, prior feature consistency regularization is introduced into the depth encoder. By taking the dense prior cost volume based on optical flow map and ego-motion as the supervising signal for feature consistency learning, the cost volume is obtained with more reasonable feature matching. To deal with the pixel-level difference of sensitivity in input frame, a sensitivity-adaptive depth decoder is built by flexibly adding a shorter path from cost volume to the final depth prediction. In this way, the back propagation of gradient to cost volume is adaptively adjusted, and an accurate depth map is decoded. The effectiveness of the proposed method is verified on public datasets. |
| 资助项目 | National Natural Science Foundation of China[62073322] ; National Natural Science Foundation of China[61836015] |
| WOS研究方向 | Computer Science ; Engineering ; Transportation |
| 语种 | 英语 |
| 出版者 | IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC |
| WOS记录号 | WOS:000981348100022 |
| 资助机构 | National Natural Science Foundation of China |
| 源URL | [http://ir.ia.ac.cn/handle/173211/53350]  |
| 专题 | 多模态人工智能系统全国重点实验室 |
| 通讯作者 | Liu, Xilong |
| 作者单位 | 1.Peking Univ, Coll Engn, Dept Adv Mfg & Robot, State Key Lab Turbulence & Complex Syst, Beijing, Peoples R China 2.Univ Chinese Acad Sci, Sch Artificial Intelligence, Beijing 100049, Peoples R China 3.Chinese Acad Sci, Inst Automat, State Key Lab Management & Control Complex Syst, Beijing 100190, Peoples R China |
| 推荐引用方式 GB/T 7714 | Liu, Jierui,Cao, Zhiqiang,Liu, Xilong,et al. Self-Supervised Monocular Depth Estimation With Geometric Prior and Pixel-Level Sensitivity[J]. IEEE TRANSACTIONS ON INTELLIGENT VEHICLES,2023,8(3):2244-2256. |
| APA | Liu, Jierui,Cao, Zhiqiang,Liu, Xilong,Wang, Shuo,&Yu, Junzhi.(2023).Self-Supervised Monocular Depth Estimation With Geometric Prior and Pixel-Level Sensitivity.IEEE TRANSACTIONS ON INTELLIGENT VEHICLES,8(3),2244-2256. |
| MLA | Liu, Jierui,et al."Self-Supervised Monocular Depth Estimation With Geometric Prior and Pixel-Level Sensitivity".IEEE TRANSACTIONS ON INTELLIGENT VEHICLES 8.3(2023):2244-2256. |
入库方式： OAI收割
来源：自动化研究所
浏览0
下载0
收藏0
其他版本
除非特别说明，本系统中所有内容都受版权保护，并保留所有权利。