中国科学院机构知识库网格
Chinese Academy of Sciences Institutional Repositories Grid
Visuals to Text: A Comprehensive Review on Automatic Image Captioning

文献类型:期刊论文

作者Yue Ming; Nannan Hu; Chunxiao Fan; Fan Feng; Jiangwan Zhou; Hui Yu
刊名IEEE/CAA Journal of Automatica Sinica
出版日期2022
卷号9期号:8页码:1339-1365
关键词Artificial intelligence attention mechanism encoder-decoder framework image captioning multi-modal understanding training strategies
ISSN号2329-9266
DOI10.1109/JAS.2022.105734
英文摘要Image captioning refers to automatic generation of descriptive texts according to the visual content of images. It is a technique integrating multiple disciplines including the computer vision (CV), natural language processing (NLP) and artificial intelligence. In recent years, substantial research efforts have been devoted to generate image caption with impressive progress. To summarize the recent advances in image captioning, we present a comprehensive review on image captioning, covering both traditional methods and recent deep learning-based techniques. Specifically, we first briefly review the early traditional works based on the retrieval and template. Then deep learning-based image captioning researches are focused, which is categorized into the encoder-decoder framework, attention mechanism and training strategies on the basis of model structures and training manners for a detailed introduction. After that, we summarize the publicly available datasets, evaluation metrics and those proposed for specific requirements, and then compare the state of the art methods on the MS COCO dataset. Finally, we provide some discussions on open challenges and future research directions.
源URL[http://ir.ia.ac.cn/handle/173211/49647]  
专题自动化研究所_学术期刊_IEEE/CAA Journal of Automatica Sinica
推荐引用方式
GB/T 7714
Yue Ming,Nannan Hu,Chunxiao Fan,et al. Visuals to Text: A Comprehensive Review on Automatic Image Captioning[J]. IEEE/CAA Journal of Automatica Sinica,2022,9(8):1339-1365.
APA Yue Ming,Nannan Hu,Chunxiao Fan,Fan Feng,Jiangwan Zhou,&Hui Yu.(2022).Visuals to Text: A Comprehensive Review on Automatic Image Captioning.IEEE/CAA Journal of Automatica Sinica,9(8),1339-1365.
MLA Yue Ming,et al."Visuals to Text: A Comprehensive Review on Automatic Image Captioning".IEEE/CAA Journal of Automatica Sinica 9.8(2022):1339-1365.

入库方式: OAI收割

来源:自动化研究所

浏览0
下载0
收藏0
其他版本

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。