Scribble-Supervised Video Object Segmentation
文献类型：期刊论文
| 作者 | Peiliang Huang; Junwei Han; Nian Liu; Jun Ren; Dingwen Zhang |
| 刊名 | IEEE/CAA Journal of Automatica Sinica
 |
| 出版日期 | 2022 |
| 卷号 | 9期号:2页码:339-353 |
| 关键词 | Convolutional neural networks (CNNs) scribble self-attention video object segmentation weakly supervised |
| ISSN号 | 2329-9266 |
| DOI | 10.1109/JAS.2021.1004210 |
| 英文摘要 | Recently, video object segmentation has received great attention in the computer vision community. Most of the existing methods heavily rely on the pixel-wise human annotations, which are expensive and time-consuming to obtain. To tackle this problem, we make an early attempt to achieve video object segmentation with scribble-level supervision, which can alleviate large amounts of human labor for collecting the manual annotation. However, using conventional network architectures and learning objective functions under this scenario cannot work well as the supervision information is highly sparse and incomplete. To address this issue, this paper introduces two novel elements to learn the video object segmentation model. The first one is the scribble attention module, which captures more accurate context information and learns an effective attention map to enhance the contrast between foreground and background. The other one is the scribble-supervised loss, which can optimize the unlabeled pixels and dynamically correct inaccurate segmented areas during the training stage. To evaluate the proposed method, we implement experiments on two video object segmentation benchmark datasets, YouTube-video object segmentation (VOS), and densely annotated video segmentation (DAVIS)-2017. We first generate the scribble annotations from the original per-pixel annotations. Then, we train our model and compare its test performance with the baseline models and other existing works. Extensive experiments demonstrate that the proposed method can work effectively and approach to the methods requiring the dense per-pixel annotations. |
| 源URL | [http://ir.ia.ac.cn/handle/173211/45994]  |
| 专题 | 自动化研究所_学术期刊_IEEE/CAA Journal of Automatica Sinica |
| 推荐引用方式 GB/T 7714 | Peiliang Huang,Junwei Han,Nian Liu,et al. Scribble-Supervised Video Object Segmentation[J]. IEEE/CAA Journal of Automatica Sinica,2022,9(2):339-353. |
| APA | Peiliang Huang,Junwei Han,Nian Liu,Jun Ren,&Dingwen Zhang.(2022).Scribble-Supervised Video Object Segmentation.IEEE/CAA Journal of Automatica Sinica,9(2),339-353. |
| MLA | Peiliang Huang,et al."Scribble-Supervised Video Object Segmentation".IEEE/CAA Journal of Automatica Sinica 9.2(2022):339-353. |
入库方式： OAI收割
来源：自动化研究所
浏览0
下载0
收藏0
其他版本
除非特别说明，本系统中所有内容都受版权保护，并保留所有权利。