中国科学院机构知识库网格
Chinese Academy of Sciences Institutional Repositories Grid
首页 机构 成果 学者
  
  1. CAS IR Grid
  2. 计算技术研究所
  3. 中国科学院计算技术研究所
  4. 中国科学院计算技术研究所期刊论文
  5. 英文
A multi-layer deep fusion convolutional neural network for sketch based image retrieval

文献类型：期刊论文

作者Yu, Deng1; Liu, Yujie1; Pang, Yunping1; Li, Zongmin1; Li, Hua2
刊名NEUROCOMPUTING
出版日期2018-06-28
卷号296页码:23-32
关键词Cross-domain retrieval Multi-layer modeling Deep feature fusion
ISSN号0925-2312
DOI10.1016/j.neucom.2018.03.031
英文摘要The purpose of this paper is to introduce a new approach for the free-hand sketch representation in the sketch based image retrieval (SBIR), where the sketches are treated as the queries to search for the natural photos in the natural image dataset. This task is known as an extremely challenging work for 3 main reasons: (i) sketches show a highly abstract visual appearance versus natural photos, fewer context can be extracted as descriptors using the existing methods, (ii) for the same object, different people provide widely different sketches, making sketch-photo matching harder, (iii) mapping the sketches and photos into a common domain is also a challenging task. In this paper, we address the cross-domain question using a strategy of mapping sketches and natural photos in multiple layers. For the first time, we introduce a multi-layer deep CNNs framework to train the multi-layer representation of free hand sketches and natural photos. We use Flickr15k dataset as benchmark for the retrieval and show that our learned representation significantly outperformances both hand-crafted features as well as deep features trained by sketches or photos. (C) 2018 Elsevier B.V. All rights reserved.
资助项目Shandong Provincial Natural Science Foundation[ZR2015FM011] ; Shandong Provincial Natural Science Foundation[ZR2013FM036] ; National Natural Science Foundation of China[61379106] ; National Natural Science Foundation of China[61379082] ; National Natural Science Foundation of China[61227802]
WOS研究方向Computer Science
语种英语
WOS记录号WOS:000430227900003
出版者ELSEVIER SCIENCE BV
源URL[http://119.78.100.204/handle/2XEOYT63/5767]  
专题中国科学院计算技术研究所期刊论文_英文
通讯作者Liu, Yujie
作者单位1.China Univ Petr, Coll Comp & Commun Engn, Qingdao 266580, Peoples R China
2.Univ Chinese Acad Sci, Inst Comp Technol, Beijing 100190, Peoples R China
推荐引用方式
GB/T 7714		 Yu, Deng,Liu, Yujie,Pang, Yunping,et al. A multi-layer deep fusion convolutional neural network for sketch based image retrieval[J]. NEUROCOMPUTING,2018,296:23-32.
APA Yu, Deng,Liu, Yujie,Pang, Yunping,Li, Zongmin,&Li, Hua.(2018).A multi-layer deep fusion convolutional neural network for sketch based image retrieval.NEUROCOMPUTING,296,23-32.
MLA Yu, Deng,et al."A multi-layer deep fusion convolutional neural network for sketch based image retrieval".NEUROCOMPUTING 296(2018):23-32.

入库方式： OAI收割

来源：计算技术研究所

浏览0
下载0
收藏0
其他版本

除非特别说明，本系统中所有内容都受版权保护，并保留所有权利。