中国科学院机构知识库网格
Chinese Academy of Sciences Institutional Repositories Grid
OpenSlot: Mixed Open-Set Recognition With Object-Centric Learning

文献类型:期刊论文

作者Yin, Xu1; Pan, Fei2; An, Guoyuan1; Huo, Yuchi3,4; Xie, Zixuan5; Yoon, Sung-Eui6
刊名IEEE TRANSACTIONS ON MULTIMEDIA
出版日期2025
卷号27页码:6019-6030
关键词Semantics Training Object detection Benchmark testing Image reconstruction Dogs Safety Prototypes Object recognition Linear programming Mixed open-set recognition object-centric learning open-set object detection
ISSN号1520-9210
DOI10.1109/TMM.2025.3565972
英文摘要Existing open-set recognition (OSR) studies typically assume that each image contains only one class label,with the unknown test set (negative) having a disjoint label space from the known test set (positive), a scenario referred to as full-label shift. This paper introduces the mixed OSR problem, where test images contain multiple class semantics, with both known and unknown classes co-occurring in the negatives, leading to a more complex super-label shift that better reflects real-world scenarios. To tackle this challenge, we propose the OpenSlot framework, based on object-centric learning, which uses slot features to represent diverse class semantics and generate class predictions. The proposed anti-noise slot (ANS) technique helps mitigate the impact of noise (invalid or background) slots during classification training, addressing the semantic misalignment between class predictions and ground truth. We evaluate OpenSlot on both mixed and conventional OSR benchmarks. Without elaborate designs, our method not only excels existing approaches in detecting super-label shifts across OSR tasks, but also achieves state-of-the-art performance on conventional benchmarks. Meanwhile, OpenSlot can localize class objects without using bounding boxes during training, demonstrating competitive performance in open-set object detection and potential for generalization.
资助项目Institute of Information & Communications Technology Planning & Evaluation (IITP) grant - Korea government (MSIT)[RS-2023-00237965] ; Recognition, Action and Interaction Algorithms for Open-world Robot Service ; National Research Foundation of Korea - Korea government (MSIT)[RS-2023-00208506] ; National Key Research and Development Program of China[2024YDLN0011] ; National Natural Science Foundation of China[62441205]
WOS研究方向Computer Science ; Telecommunications
语种英语
WOS记录号WOS:001579069300032
出版者IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
源URL[http://119.78.100.204/handle/2XEOYT63/41682]  
专题中国科学院计算技术研究所期刊论文_英文
通讯作者Yoon, Sung-Eui
作者单位1.Korea Adv Inst Sci & Technol, Sch Comp, Daejeon 34141, South Korea
2.Univ Michigan, Sch Comp Sci & Engn, Ann Arbor, MI 48109 USA
3.Zhejiang Univ, State Key Lab CAD & CG, Hangzhou 310027, Zhejiang, Peoples R China
4.Zhejiang Lab, Hangzhou 310058, Peoples R China
5.Univ Chinese Acad Sci, Inst Comp Technol, Beijing 100190, Peoples R China
6.Korea Adv Inst Sci & Technol, Fac Sch Comp, Deajeon 34141, South Korea
推荐引用方式
GB/T 7714
Yin, Xu,Pan, Fei,An, Guoyuan,et al. OpenSlot: Mixed Open-Set Recognition With Object-Centric Learning[J]. IEEE TRANSACTIONS ON MULTIMEDIA,2025,27:6019-6030.
APA Yin, Xu,Pan, Fei,An, Guoyuan,Huo, Yuchi,Xie, Zixuan,&Yoon, Sung-Eui.(2025).OpenSlot: Mixed Open-Set Recognition With Object-Centric Learning.IEEE TRANSACTIONS ON MULTIMEDIA,27,6019-6030.
MLA Yin, Xu,et al."OpenSlot: Mixed Open-Set Recognition With Object-Centric Learning".IEEE TRANSACTIONS ON MULTIMEDIA 27(2025):6019-6030.

入库方式: OAI收割

来源:计算技术研究所

浏览0
下载0
收藏0
其他版本

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。