Automatically Discovering Novel Visual Categories With Adaptive Prototype Learning
文献类型:期刊论文
作者 | Lu Zhang1![]() ![]() ![]() ![]() ![]() |
刊名 | https://ieeexplore.ieee.org/abstract/document/10328468
![]() |
出版日期 | 2024-04 |
卷号 | 46期号:4页码:2533-2544 |
文献子类 | - |
英文摘要 | This article targets the task of novel category discovery (NCD), which aims to discover unknown categories when a certain number of classes are already known. The NCD task is challenging due to its closeness to real-world scenarios, where we have only encountered some partial classes and corresponding images. Unlike previous approaches to NCD, we propose a novel adaptive prototype learning method that leverages prototypes to emphasize category discrimination and alleviate the issue of missing annotations for novel classes. Concretely, the proposed method consists of two main stages: prototypical representation learning and prototypical self-training. In the first stage, we develop a robust feature extractor that could effectively handle images from both base and novel categories. This ability of instance and category discrimination of the feature extractor is boosted by self-supervised learning and adaptive prototypes. In the second stage, we utilize the prototypes again to rectify offline pseudo labels and train a final parametric classifier for category clustering. We conduct extensive experiments on four benchmark datasets, demonstrating our method’s effectiveness and robustness with state-of-the-art performance. |
语种 | 英语 |
源URL | [http://ir.ia.ac.cn/handle/173211/57280] ![]() |
专题 | 多模态人工智能系统全国重点实验室 |
通讯作者 | Zhiyong Liu |
作者单位 | 1.State Key Laboratory of Multimodal Artifi cial Intelligence Systems, Institute of Automation, Chinese Academy of Sciences 2.University of California at Merced |
推荐引用方式 GB/T 7714 | Lu Zhang,Lu Qi,Xu Yang,et al. Automatically Discovering Novel Visual Categories With Adaptive Prototype Learning[J]. https://ieeexplore.ieee.org/abstract/document/10328468,2024,46(4):2533-2544. |
APA | Lu Zhang,Lu Qi,Xu Yang,Hong Qiao,Ming-Hsuan Yang,&Zhiyong Liu.(2024).Automatically Discovering Novel Visual Categories With Adaptive Prototype Learning.https://ieeexplore.ieee.org/abstract/document/10328468,46(4),2533-2544. |
MLA | Lu Zhang,et al."Automatically Discovering Novel Visual Categories With Adaptive Prototype Learning".https://ieeexplore.ieee.org/abstract/document/10328468 46.4(2024):2533-2544. |
入库方式: OAI收割
来源:自动化研究所
其他版本
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。