Self-Paced Learning: An Implicit Regularization Perspective
文献类型:会议论文
作者 | Yanbo Fan1,4![]() ![]() ![]() ![]() |
出版日期 | 2017 |
会议日期 | 2017 |
会议地点 | San Francisco, California USA |
英文摘要 |
Self-paced learning (SPL) mimics the cognitive mechanism of humans and animals that gradually learns from easy to hard samples. One key issue in SPL is to obtain better weighting strategy that is determined by the minimizer function. Existing
methods usually pursue this by artificially designing the explicit form of SPL regularizer. In this paper, we study a group of new regularizer (named self-paced implicit regularizer)
that is deduced from robust loss function. Based on the convex conjugacy theory, the minimizer function for selfpaced implicit regularizer can be directly learned from the
latent loss function, while the analytic form of the regularizer can be even unknown. A general framework (named SPL-IR) for SPL is developed accordingly. We demonstrate that the learning procedure of SPL-IR is associated with latent robust loss functions, thus can provide some theoretical insights for its working mechanism. We further analyze the relation between SPL-IR and half-quadratic optimization and provide a group of self-paced implicit regularizer. Finally, we implement SPL-IR to both supervised and unsupervised asks, and experimental results corroborate our ideas and demonstrate the correctness and effectiveness of implicit regularizers. |
源URL | [http://ir.ia.ac.cn/handle/173211/19999] ![]() |
专题 | 自动化研究所_模式识别国家重点实验室_多媒体计算与图形学团队 |
作者单位 | 1.National Laboratory of Pattern Recognition, CASIA 2.Center for Research on Intelligent Perception and Computing, CASIA 3.Center for Excellence in Brain Science and Intelligence Technology, CAS 4.University of Chinese Academy of Sciences |
推荐引用方式 GB/T 7714 | Yanbo Fan,Ran He,Jian Liang,et al. Self-Paced Learning: An Implicit Regularization Perspective[C]. 见:. San Francisco, California USA. 2017. |
入库方式: OAI收割
来源:自动化研究所
浏览0
下载0
收藏0
其他版本
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。