中国科学院机构知识库网格
Chinese Academy of Sciences Institutional Repositories Grid
Gated Object-Attribute Matching Network for Detailed Image Caption

文献类型:期刊论文

作者Yun, Jing1,2; Xu, ZhiWei3; Gao, GuangLai1
刊名MATHEMATICAL PROBLEMS IN ENGINEERING
出版日期2020-01-13
卷号2020页码:11
ISSN号1024-123X
DOI10.1155/2020/9562587
英文摘要Image caption enables computers to generate a text description of images automatically. However, the generated description is not good enough recently. Computers can describe what objects are in the image but cannot give more details about these objects. In this study, we present a novel image caption approach to give more details when describing objects. In detail, a visual attention-based LSTM is used to find the objects, as well as a semantic attention-based LSTM is used for giving semantic attributes. At last, a gated object-attribute matching network is used to match the objects to their semantic attributes. The experiments on the public datasets of Flickr30k and MSCOCO demonstrate that the proposed approach improved the quality of the image caption, compared with the most advanced methods at present.
资助项目Natural Science Foundation of Education Department Inner Mongolian Autonomous Region[NJZY19083]
WOS研究方向Engineering ; Mathematics
语种英语
WOS记录号WOS:000510035000007
出版者HINDAWI LTD
源URL[http://119.78.100.204/handle/2XEOYT63/14739]  
专题中国科学院计算技术研究所期刊论文_英文
通讯作者Yun, Jing
作者单位1.Inner Mongolia Univ, Dept Comp Sci, Hohhot 010021, Peoples R China
2.Inner Mongolia Univ Technol, Coll Data Sci & Applicat, Hohhot 010080, Peoples R China
3.Chinese Acad Sci, Inst Comp Technol, Beijing 100080, Peoples R China
推荐引用方式
GB/T 7714
Yun, Jing,Xu, ZhiWei,Gao, GuangLai. Gated Object-Attribute Matching Network for Detailed Image Caption[J]. MATHEMATICAL PROBLEMS IN ENGINEERING,2020,2020:11.
APA Yun, Jing,Xu, ZhiWei,&Gao, GuangLai.(2020).Gated Object-Attribute Matching Network for Detailed Image Caption.MATHEMATICAL PROBLEMS IN ENGINEERING,2020,11.
MLA Yun, Jing,et al."Gated Object-Attribute Matching Network for Detailed Image Caption".MATHEMATICAL PROBLEMS IN ENGINEERING 2020(2020):11.

入库方式: OAI收割

来源:计算技术研究所

浏览0
下载0
收藏0
其他版本

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。