中国科学院机构知识库网格
Chinese Academy of Sciences Institutional Repositories Grid
首页 机构 成果 学者
  
  1. CAS IR Grid
  2. 自动化研究所
  3. 中国科学院自动化研究所
  4. 紫东太初大模型研究中心
  5. 图像与视频分析团队
A three-level framework for affective content analysis and its case studies

文献类型：期刊论文

作者Xu, Min1,2; Wang, Jinqiao2; He, Xiangjian1; Jin, Jesse S.3; Luo, Suhuai3; Lu, Hanqing2
刊名MULTIMEDIA TOOLS AND APPLICATIONS
出版日期2014-05-01
卷号70期号:2页码:757-779
关键词Affective content analysis Mid-level representation Multiple modality
英文摘要Emotional factors directly reflect audiences' attention, evaluation and memory. Recently, video affective content analysis attracts more and more research efforts. Most of the existing methods map low-level affective features directly to emotions by applying machine learning. Compared to human perception process, there is actually a gap between low-level features and high-level human perception of emotion. In order to bridge the gap, we propose a three-level affective content analysis framework by introducing mid-level representation to indicate dialog, audio emotional events (e. g., horror sounds and laughters) and textual concepts (e.g., informative keywords). Mid-level representation is obtained from machine learning on low-level features and used to infer high-level affective content. We further apply the proposed framework and focus on a number of case studies. Audio emotional event, dialog and subtitle are studied to assist affective content detection in different video domains/genres. Multiple modalities are considered for affective analysis, since different modality has its own merit to evoke emotions. Experimental results shows the proposed framework is effective and efficient for affective content analysis. Audio emotional event, dialog and subtitle are promising mid-level representations.
WOS标题词Science & Technology ; Technology
类目[WOS]Computer Science, Information Systems ; Computer Science, Software Engineering ; Computer Science, Theory & Methods ; Engineering, Electrical & Electronic
研究领域[WOS]Computer Science ; Engineering
关键词[WOS]VIDEO ; RECOGNITION ; RETRIEVAL ; FILM
收录类别SCI
语种英语
WOS记录号WOS:000336995900009
源URL[http://ir.ia.ac.cn/handle/173211/3361]  
专题自动化研究所_模式识别国家重点实验室_图像与视频分析团队
作者单位1.Univ Technol Sydney, Ctr Innovat IT Serv & Applicat, Sydney, NSW 2007, Australia
2.Chinese Acad Sci, Inst Automat, Natl Lab Pattern Recognit, Beijing, Peoples R China
3.Univ Newcastle, Sch Design Commun & IT, Callaghan, NSW 2308, Australia
推荐引用方式
GB/T 7714		 Xu, Min,Wang, Jinqiao,He, Xiangjian,et al. A three-level framework for affective content analysis and its case studies[J]. MULTIMEDIA TOOLS AND APPLICATIONS,2014,70(2):757-779.
APA Xu, Min,Wang, Jinqiao,He, Xiangjian,Jin, Jesse S.,Luo, Suhuai,&Lu, Hanqing.(2014).A three-level framework for affective content analysis and its case studies.MULTIMEDIA TOOLS AND APPLICATIONS,70(2),757-779.
MLA Xu, Min,et al."A three-level framework for affective content analysis and its case studies".MULTIMEDIA TOOLS AND APPLICATIONS 70.2(2014):757-779.

入库方式： OAI收割

来源：自动化研究所

浏览0
下载0
收藏0
其他版本

除非特别说明，本系统中所有内容都受版权保护，并保留所有权利。