中国科学院机构知识库网格
Chinese Academy of Sciences Institutional Repositories Grid
Script-to-Movie: A Computational Framework for Story Movie Composition

文献类型:期刊论文

作者Liang, Chao1; Xu, Changsheng1,2; Cheng, Jian1,2; Min, Weiqing1,2; Lu, Hanqing1,2
刊名IEEE TRANSACTIONS ON MULTIMEDIA
出版日期2013-02-01
卷号15期号:2页码:401-414
关键词Movie composition script and video analysis computational framework
英文摘要Traditional movie production has always been a highly professional work that needs team collaboration, advanced devices and techniques, and vast time and money investment. These high threshold requirements not only prevent mass amateur enthusiasts entering this field, but also hinder professionals quickly previewing their conceived story plots. In this paper, we raise a novel application, named script-to-movie (S2M) composition, to automatically produce new movies from existing videos in accordance with user created script. Our motivation is to liberate producers from complex filming and editing operations, thereby people's story idea can be instantly converted into the vivid movie video. To support the novel "What You Dream Is What You See" (WYDIWYS) production mode, we first propose a hierarchical alignment method to automatically construct a video material database with detailed semantic description. Considering diverse story plots in user designed script, the database contains abundant video materials about different characters appearing in various time and places conditions. On this basis, the S2M composition is formulated as a constrained optimization problem, where semantic story plot and syntactic visual content are synthetically considered to identify a group of optimal video segments to narrate the user designed script story. Both quantitative and qualitative experimental results are reported to illustrate the effectiveness of the proposed S2M application.
WOS标题词Science & Technology ; Technology
类目[WOS]Computer Science, Information Systems ; Computer Science, Software Engineering ; Telecommunications
研究领域[WOS]Computer Science ; Telecommunications
关键词[WOS]VIDEO
收录类别SCI
语种英语
WOS记录号WOS:000313875500015
源URL[http://ir.ia.ac.cn/handle/173211/3349]  
专题自动化研究所_模式识别国家重点实验室_图像与视频分析团队
作者单位1.Chinese Acad Sci, Inst Automat, Natl Lab Pattern Recognit, Beijing 100190, Peoples R China
2.China Singapore Inst Digital Media, Singapore 119615, Singapore
推荐引用方式
GB/T 7714
Liang, Chao,Xu, Changsheng,Cheng, Jian,et al. Script-to-Movie: A Computational Framework for Story Movie Composition[J]. IEEE TRANSACTIONS ON MULTIMEDIA,2013,15(2):401-414.
APA Liang, Chao,Xu, Changsheng,Cheng, Jian,Min, Weiqing,&Lu, Hanqing.(2013).Script-to-Movie: A Computational Framework for Story Movie Composition.IEEE TRANSACTIONS ON MULTIMEDIA,15(2),401-414.
MLA Liang, Chao,et al."Script-to-Movie: A Computational Framework for Story Movie Composition".IEEE TRANSACTIONS ON MULTIMEDIA 15.2(2013):401-414.

入库方式: OAI收割

来源:自动化研究所

浏览0
下载0
收藏0
其他版本

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。