中国科学院机构知识库网格
Chinese Academy of Sciences Institutional Repositories Grid
Automatically Discovering Novel Visual Categories With Adaptive Prototype Learning

文献类型:期刊论文

作者Lu Zhang1; Lu Qi2; Xu Yang1; Hong Qiao1; Ming-Hsuan Yang2; Zhiyong Liu1
刊名https://ieeexplore.ieee.org/abstract/document/10328468
出版日期2024-04
卷号46期号:4页码:2533-2544
文献子类-
英文摘要

This article targets the task of novel category discovery (NCD), which aims to discover unknown categories when a certain number of classes are already known. The NCD task is challenging due to its closeness to real-world scenarios, where we have only encountered some partial classes and corresponding images. Unlike previous approaches to NCD, we propose a novel adaptive prototype learning method that leverages prototypes to emphasize category discrimination and alleviate the issue of missing annotations for novel classes. Concretely, the proposed method consists of two main stages: prototypical representation learning and prototypical self-training. In the first stage, we develop a robust feature extractor that could effectively handle images from both base and novel categories. This ability of instance and category discrimination of the feature extractor is boosted by self-supervised learning and adaptive prototypes. In the second stage, we utilize the prototypes again to rectify offline pseudo labels and train a final parametric classifier for category clustering. We conduct extensive experiments on four benchmark datasets, demonstrating our method’s effectiveness and robustness with state-of-the-art performance.

语种英语
源URL[http://ir.ia.ac.cn/handle/173211/57280]  
专题多模态人工智能系统全国重点实验室
通讯作者Zhiyong Liu
作者单位1.State Key Laboratory of Multimodal Artifi cial Intelligence Systems, Institute of Automation, Chinese Academy of Sciences
2.University of California at Merced
推荐引用方式
GB/T 7714
Lu Zhang,Lu Qi,Xu Yang,et al. Automatically Discovering Novel Visual Categories With Adaptive Prototype Learning[J]. https://ieeexplore.ieee.org/abstract/document/10328468,2024,46(4):2533-2544.
APA Lu Zhang,Lu Qi,Xu Yang,Hong Qiao,Ming-Hsuan Yang,&Zhiyong Liu.(2024).Automatically Discovering Novel Visual Categories With Adaptive Prototype Learning.https://ieeexplore.ieee.org/abstract/document/10328468,46(4),2533-2544.
MLA Lu Zhang,et al."Automatically Discovering Novel Visual Categories With Adaptive Prototype Learning".https://ieeexplore.ieee.org/abstract/document/10328468 46.4(2024):2533-2544.

入库方式: OAI收割

来源:自动化研究所

浏览0
下载0
收藏0
其他版本

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。