Query-Conditioned Three-Player Adversarial Network for Video Summarization
文献类型:会议论文
作者 | Yujia Zhang1,2![]() ![]() |
出版日期 | 2018-08 |
会议日期 | 2018-8 |
会议地点 | Newcastle upon Tyne, UK |
英文摘要 | Video summarization plays an important role in video understanding by selecting key frames/shots. Traditionally, it aims to find the most representative and diverse contents in a video as short summaries. Recently, a more generalized task, query-conditioned video summarization, has been introduced, which takes user queries into consideration to learn more user-oriented summaries. In this paper, we propose a query-conditioned three-player generative adversarial network to tackle this challenge. The generator learns the joint representation of the user query and the video content, and the discriminator takes three pairs of query-conditioned summaries as the input to discriminate the real summary from a generated and a random one. A three-player loss is introduced for joint training of the generator and the discriminator, which forces the generator to learn better summary results, and avoids the generation of random trivial summaries. Experiments on a recently proposed query-conditioned video summarization benchmark dataset show the efficiency and efficacy of our proposed method. |
源URL | [http://ir.ia.ac.cn/handle/173211/23650] ![]() |
专题 | 自动化研究所_复杂系统管理与控制国家重点实验室_先进机器人控制团队 |
通讯作者 | Yujia Zhang |
作者单位 | 1.Institute of Automation, Chinese Academy of Sciences 2.University of Chinese Academy of Sciences 3.UiT The Arctic University of Norway 4.Carnegie Mellon University |
推荐引用方式 GB/T 7714 | Yujia Zhang,Michael Kampffmeyer,Xiaodan Liang,et al. Query-Conditioned Three-Player Adversarial Network for Video Summarization[C]. 见:. Newcastle upon Tyne, UK. 2018-8. |
入库方式: OAI收割
来源:自动化研究所
其他版本
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。