中国科学院机构知识库网格
Chinese Academy of Sciences Institutional Repositories Grid
Chat with illustration

文献类型:期刊论文

作者Jiang, Yu; Liu, Jing; Lu, Hanqing
刊名MULTIMEDIA SYSTEMS
出版日期2016-02-01
卷号22期号:1页码:5-16
关键词Instant messaging service Text-to-picture Layout
英文摘要Instant messaging service is an important aspect of social media and sprung up in last decades. Traditional instant messaging service transfers information mainly based on textual message, while the visual message is ignored to a great extent. Such instant messaging service is thus far from satisfactory in all-around information communication. In this paper, we propose a novel visual assisted instant messaging scheme named Chat with illustration (CWI), which presents users visual messages associated with textual message automatically. When users start their chat, the system first identifies meaningful keywords from dialogue content and analyzes grammatical and logical relations. Then CWI explores keyword-based image search on a hierarchically clustering image database which is built offline. Finally, according to grammatical and logical relations, CWI assembles these images properly and presents an optimal visual message. With the combination of textual and visual message, users could get a more interesting and vivid communication experience. Especially for different native language speakers, CWI can help them cross language barrier to some degree. In addition, a visual dialogue summarization is also proposed, which help users recall the past dialogue. The in-depth user studies demonstrate the effectiveness of our visual assisted instant messaging scheme.
WOS标题词Science & Technology ; Technology
类目[WOS]Computer Science, Information Systems ; Computer Science, Theory & Methods
研究领域[WOS]Computer Science
关键词[WOS]TEXT ; SYSTEM
收录类别SCI
语种英语
WOS记录号WOS:000368828500002
源URL[http://ir.ia.ac.cn/handle/173211/10667]  
专题自动化研究所_模式识别国家重点实验室_图像与视频分析团队
作者单位Chinese Acad Sci, Inst Automat, Natl Lab Pattern Recognit, Beijing, Peoples R China
推荐引用方式
GB/T 7714
Jiang, Yu,Liu, Jing,Lu, Hanqing. Chat with illustration[J]. MULTIMEDIA SYSTEMS,2016,22(1):5-16.
APA Jiang, Yu,Liu, Jing,&Lu, Hanqing.(2016).Chat with illustration.MULTIMEDIA SYSTEMS,22(1),5-16.
MLA Jiang, Yu,et al."Chat with illustration".MULTIMEDIA SYSTEMS 22.1(2016):5-16.

入库方式: OAI收割

来源:自动化研究所

浏览0
下载0
收藏0
其他版本

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。