Name-face association with web facial image supervision
文献类型：期刊论文
| 作者 | Chen, Zhineng1 ; Zhang, Wei2; Deng, Bin3; Xie, Hongtao2; Gu, Xiaoyan2
|
| 刊名 | MULTIMEDIA SYSTEMS
 |
| 出版日期 | 2019-02-01 |
| 卷号 | 25期号:1页码:1-20 |
| ISSN号 | 0942-4962 |
| 关键词 | Name-face association Image matching Multimedia fusion Web facial images Weakly supervised |
| DOI | 10.1007/s00530-017-0544-y |
| 通讯作者 | Xie, Hongtao(xiehongtao@iie.ac.cn) |
| 英文摘要 | This paper describes methods for automatically associating faces detected from multimedia documents with their names presented in the surrounding metadata. We consider the task in the image matching (IM) framework, where external Web facial images are automatically retrieved as the gallery face set of the names in advance, and a detected face is assigned to one of the names, or none of them, according to the association score between the two kinds of faces and constraints. Several important issues are investigated within the IM framework. In collecting Web facial images, beyond the basic scheme that use a celebrity name purely as the query to crawl facial images, a context-assisted image search method is proposed to enhance the relevance and discriminability of the retrieved faces. In constraint formulation, we propose an assigning-thresholding (AT) pipeline to uniformly ensure that the name-face correspondence is strictly one-to-one, and set low confidence associations as null assignments. In association score computation, we propose methods that jointly consider IM with the well-established graph-based association (GA) method at different stages, aiming at producing more accurate scores to benefit the association. Based on these efforts, an Accu-IM method performing the association as accurate as possible and a Fast-IM method performing the association in real-time are respective proposed. Extensive experiments on datasets of captioned News images and Web videos both demonstrate the advantages of the proposed efforts individually and jointly, which consistently provide improvement gains under different settings when compared with state-of-the-art methods. |
| WOS关键词 | RECOGNITION ; ANNOTATION ; IDENTIFICATION ; VERIFICATION ; DISCOVERY ; SCHEME ; VIDEOS ; MOVIE |
| 资助项目 | National Nature Science Foundation of China[61303175] ; National Nature Science Foundation of China[61303171] ; National Nature Science Foundation of China[61602463] |
| WOS研究方向 | Computer Science |
| 语种 | 英语 |
| 出版者 | SPRINGER |
| WOS记录号 | WOS:000459419800001 |
| 资助机构 | National Nature Science Foundation of China |
| 源URL | [http://ir.ia.ac.cn/handle/173211/25008]  |
| 专题 | 数字内容技术与服务研究中心_远程智能医疗 |
| 通讯作者 | Xie, Hongtao |
| 作者单位 | 1.Chinese Acad Sci, Inst Automat, Beijing 100190, Peoples R China 2.Chinese Acad Sci, Inst Informat Engn, Beijing 100093, Peoples R China 3.Hunan Univ Technol, Sch Comp Sci, Zhuzhou 412007, Hunan, Peoples R China |
| 推荐引用方式 GB/T 7714 | Chen, Zhineng,Zhang, Wei,Deng, Bin,et al. Name-face association with web facial image supervision[J]. MULTIMEDIA SYSTEMS,2019,25(1):1-20. |
| APA | Chen, Zhineng,Zhang, Wei,Deng, Bin,Xie, Hongtao,&Gu, Xiaoyan.(2019).Name-face association with web facial image supervision.MULTIMEDIA SYSTEMS,25(1),1-20. |
| MLA | Chen, Zhineng,et al."Name-face association with web facial image supervision".MULTIMEDIA SYSTEMS 25.1(2019):1-20. |
入库方式： OAI收割
来源：自动化研究所
浏览0
下载0
收藏0
其他版本
除非特别说明，本系统中所有内容都受版权保护，并保留所有权利。