Deep Structured Event Modeling for User-Generated Photos
文献类型：期刊论文
| 作者 | Yang, Xiaoshan1,2 ; Zhang, Tianzhu1,2; Xu, Changsheng1,2
|
| 刊名 | IEEE TRANSACTIONS ON MULTIMEDIA
 |
| 出版日期 | 2018 |
| 卷号 | 20期号:8页码:2100-2113 |
| 关键词 | Event Analysis Unusual Event Detection Deep Learning |
| DOI | 10.1109/TMM.2017.2788210 |
| 英文摘要 | Vision based event analysis plays a very critical role in automatically organizing user generated photos. It is difficult because of the following challenges. (1) Intra-class variation. Photos uploaded by users are sparsely sampled visual appearances of event over time. Thus, each photo may only capture a single object or scene of a specific complex event. (2) Inter-class confusion. Photos related to different events may contain similar objects or scenes. (3) For abnormal event, it has sample scarcity issue and only few samples can be used for event pattern learning. In this paper, by considering the photo taken time, we propose a novel structured event modeling (SEM) framework for event analysis by exploiting temporal information of visual features and event classes in photo sequence. More specifically, the temporal event patterns of the photo sequence and the relationship of different photos are learned jointly through deep neural networks (CNNs and RNNs) and conditional random field (CRF). We evaluate the proposed structured event modeling framework in two applications including the mutliclass event recognition and abnormal event discovery in photo sequence. The extensive experimental results on a public event recognition dataset and a collected abnormal event dataset demonstrate the effectiveness of the proposed method. |
| 语种 | 英语 |
| 源URL | [http://ir.ia.ac.cn/handle/173211/19702]  |
| 专题 | 自动化研究所_模式识别国家重点实验室_多媒体计算与图形学团队 |
| 作者单位 | 1.National Lab of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences 2.University of Chinese Academy of Sciences |
| 推荐引用方式 GB/T 7714 | Yang, Xiaoshan,Zhang, Tianzhu,Xu, Changsheng. Deep Structured Event Modeling for User-Generated Photos[J]. IEEE TRANSACTIONS ON MULTIMEDIA,2018,20(8):2100-2113. |
| APA | Yang, Xiaoshan,Zhang, Tianzhu,&Xu, Changsheng.(2018).Deep Structured Event Modeling for User-Generated Photos.IEEE TRANSACTIONS ON MULTIMEDIA,20(8),2100-2113. |
| MLA | Yang, Xiaoshan,et al."Deep Structured Event Modeling for User-Generated Photos".IEEE TRANSACTIONS ON MULTIMEDIA 20.8(2018):2100-2113. |
入库方式： OAI收割
来源：自动化研究所
浏览0
下载0
收藏0
其他版本
除非特别说明，本系统中所有内容都受版权保护，并保留所有权利。