中国科学院机构知识库网格
Chinese Academy of Sciences Institutional Repositories Grid
Query-Conditioned Three-Player Adversarial Network for Video Summarization

文献类型:会议论文

作者Yujia Zhang1,2; Michael Kampffmeyer3; Xiaodan Liang4; Min Tan1,2; Eric P. Xing4
出版日期2018-08
会议日期2018-8
会议地点Newcastle upon Tyne, UK
英文摘要

Video summarization plays an important role in video understanding by selecting key frames/shots. Traditionally, it aims to find the most representative and diverse contents in a video as short summaries. Recently, a more generalized task, query-conditioned video summarization, has been introduced, which takes user queries into consideration to learn more user-oriented summaries. In this paper, we propose a query-conditioned three-player generative adversarial network to tackle this challenge. The generator learns the joint representation of the user query and the video content, and the discriminator takes three pairs of query-conditioned summaries as the input to discriminate the real summary from a generated and a random one. A three-player loss is introduced for joint training of the generator and the discriminator, which forces the generator to learn better summary results, and avoids the generation of random trivial summaries. Experiments on a recently proposed query-conditioned video summarization benchmark dataset show the efficiency and efficacy of our proposed method.

源URL[http://ir.ia.ac.cn/handle/173211/23650]  
专题自动化研究所_复杂系统管理与控制国家重点实验室_先进机器人控制团队
通讯作者Yujia Zhang
作者单位1.Institute of Automation, Chinese Academy of Sciences
2.University of Chinese Academy of Sciences
3.UiT The Arctic University of Norway
4.Carnegie Mellon University
推荐引用方式
GB/T 7714
Yujia Zhang,Michael Kampffmeyer,Xiaodan Liang,et al. Query-Conditioned Three-Player Adversarial Network for Video Summarization[C]. 见:. Newcastle upon Tyne, UK. 2018-8.

入库方式: OAI收割

来源:自动化研究所

浏览0
下载0
收藏0
其他版本

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。