Exploiting Visual-Audio-Textual Characteristics for Automatic TV Commercial Block Detection and Segmentation
文献类型:期刊论文
作者 | Liu, Nan1,2; Zhao, Yao1,2; Zhu, Zhenfeng1,2; Lu, Hanqing3![]() |
刊名 | IEEE TRANSACTIONS ON MULTIMEDIA
![]() |
出版日期 | 2011-10-01 |
卷号 | 13期号:5页码:961-973 |
关键词 | Commercial detection commercial segmentation multi-modal fusion text detection video analysis |
英文摘要 | Automatic TV commercial block detection (CBD) and commercial block segmentation (CBS) are two key components of a smart commercial digesting system. In this paper, we focus our research on CBD and CBS by the means of collaborative exploitation of visual-audio-textual characteristics embedded in commercials. Rather than utilizing exclusively visual-audio characteristics like most previous works, an abundance of textual characteristics associated with commercials are fully exploited. Additionally, Tri-AdaBoost, an interactive ensemble learning manner, is proposed to form a consolidated semantic fusion across visual, audio, and textual characteristics. In order to segment a detected commercial block into multiple individual commercials, additional informative descriptors including textual characteristics are introduced to boost the robustness in the detection of frame marked with product information (FMPI). Together with the characteristics of audio spectral variation pointer and silent position, FMPI can provide a kind of complementary representation architecture to model the similarity of intra-commercial and the dissimilarity of inter-commercial. Experiments are conducted on a large video dataset from both China central television (CCTV) channels and TRECVID'05, and promising experimental results show the effectiveness of the proposed scheme. |
WOS标题词 | Science & Technology ; Technology |
类目[WOS] | Computer Science, Information Systems ; Computer Science, Software Engineering ; Telecommunications |
研究领域[WOS] | Computer Science ; Telecommunications |
关键词[WOS] | VIDEO ; STREAMS |
收录类别 | SCI |
语种 | 英语 |
WOS记录号 | WOS:000295007300011 |
源URL | [http://ir.ia.ac.cn/handle/173211/3329] ![]() |
专题 | 自动化研究所_模式识别国家重点实验室_图像与视频分析团队 |
作者单位 | 1.Beijing Jiaotong Univ, Inst Informat Sci, Beijing 100044, Peoples R China 2.Beijing Key Lab Adv Informat Sci & Network Techno, Beijing 100044, Peoples R China 3.Chinese Acad Sci, Inst Automat, Beijing 100080, Peoples R China |
推荐引用方式 GB/T 7714 | Liu, Nan,Zhao, Yao,Zhu, Zhenfeng,et al. Exploiting Visual-Audio-Textual Characteristics for Automatic TV Commercial Block Detection and Segmentation[J]. IEEE TRANSACTIONS ON MULTIMEDIA,2011,13(5):961-973. |
APA | Liu, Nan,Zhao, Yao,Zhu, Zhenfeng,&Lu, Hanqing.(2011).Exploiting Visual-Audio-Textual Characteristics for Automatic TV Commercial Block Detection and Segmentation.IEEE TRANSACTIONS ON MULTIMEDIA,13(5),961-973. |
MLA | Liu, Nan,et al."Exploiting Visual-Audio-Textual Characteristics for Automatic TV Commercial Block Detection and Segmentation".IEEE TRANSACTIONS ON MULTIMEDIA 13.5(2011):961-973. |
入库方式: OAI收割
来源:自动化研究所
浏览0
下载0
收藏0
其他版本
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。