Improving metric-based few-shot learning with dynamically scaled softmax loss
文献类型：期刊论文
| 作者 | Zhang, Yu7; Zuo, Xin7; Zheng, Xuxu6; Gao, Xiaoyong7; Wang, Bo1,4,5; Hu, Weiming2,3,5 |
| 刊名 | IMAGE AND VISION COMPUTING
 |
| 出版日期 | 2023-12-01 |
| 卷号 | 140页码:15 |
| 关键词 | Few-shot learning Metric-based learning framework Softmax loss improvement |
| ISSN号 | 0262-8856 |
| DOI | 10.1016/j.imavis.2023.104860 |
| 英文摘要 | The metric-based learning framework has been widely used in data-scarce few-shot visual classification. However, the current loss function limits the effectiveness of metric learning. One issue is that the nearest neighbor classification technique used greatly narrows the value range of similarity between the query and class prototypes, which limits the guiding ability of the loss function. The other issue is that the episode-based training setting randomizes the class combination in each iteration, which reduces the perception of the traditional softmax losses for effective learning from episodes with various data distributions.To solve these problems, we first review some variants of the softmax loss from a unified perspective, and then propose a novel DynamicallyScaled Softmax Loss (DSSL). By adding a probability regulator (for scaling probabilities) and a loss regulator (for scaling losses), the loss function can adaptively adjust the prediction distribution and the training weights of the samples, which forces the model to focus on more informative samples. Finally, we found the proposed DSSL strategy for few-shot classifiers can achieve competitive results on four generic benchmarks and a fine-grained benchmark, demonstrating the effectiveness of improving the distinguishability (for base classes) and generalizability (for novel classes) of the learned feature space. |
| 资助项目 | Beijing Natural Science Foundation[62036011] ; Beijing Natural Science Foundation[62192782] ; Beijing Natural Science Foundation[61721004] ; Beijing Natural Science Foundation[U2033210] ; Major Projects of Guangdong Edu-cation Department for Foundation Research and Applied Research[L223003] ; Guangdong Provincial University Innovation Team Project[2017KZDXM081] ; Guangdong Provincial University Innovation Team Project[2018KZDXM066] ; [2020KCXTD045] |
| WOS研究方向 | Computer Science ; Engineering ; Optics |
| 语种 | 英语 |
| WOS记录号 | WOS:001110250500001 |
| 出版者 | ELSEVIER |
| 源URL | [http://119.78.100.204/handle/2XEOYT63/38079]  |
| 专题 | 中国科学院计算技术研究所期刊论文_英文 |
| 通讯作者 | Wang, Bo |
| 作者单位 | 1.Chinese Acad Sci, Natl Lab Pattern Recognit, Inst Automat, 95 Zhongguancun East Rd, Beijing 100190, Peoples R China 2.ShanghaiTech Univ, Sch Informat Sci & Technol, Shanghai 201210, Peoples R China 3.Univ Chinese Acad Sci, Sch Artificial Intelligence, Beijing 100190, Peoples R China 4.Peking Univ, Sch Software & Microelect, Beijing 100871, Peoples R China 5.Chinese Acad Sci, Inst Automat, Natl Lab Pattern Recognit, Beijing 100190, Peoples R China 6.Chinese Acad Sci, Data Intelligence Syst Res Ctr, Inst Comp Technol, Beijing 100190, Peoples R China 7.China Univ Petr, Beijing 102249, Peoples R China |
| 推荐引用方式 GB/T 7714 | Zhang, Yu,Zuo, Xin,Zheng, Xuxu,et al. Improving metric-based few-shot learning with dynamically scaled softmax loss[J]. IMAGE AND VISION COMPUTING,2023,140:15. |
| APA | Zhang, Yu,Zuo, Xin,Zheng, Xuxu,Gao, Xiaoyong,Wang, Bo,&Hu, Weiming.(2023).Improving metric-based few-shot learning with dynamically scaled softmax loss.IMAGE AND VISION COMPUTING,140,15. |
| MLA | Zhang, Yu,et al."Improving metric-based few-shot learning with dynamically scaled softmax loss".IMAGE AND VISION COMPUTING 140(2023):15. |
入库方式： OAI收割
来源：计算技术研究所
浏览0
下载0
收藏0
其他版本
除非特别说明，本系统中所有内容都受版权保护，并保留所有权利。