Bridging Music and Image:A Preliminary Study with Multiple Ranking CCA Learning
文献类型：会议论文
| 作者 | Xixuan Wu; Yu Qiao; Xiaogang Wang; Xiaoou Tang |
| 出版日期 | 2012 |
| 会议名称 | Proc. ACM Multimedia (ACM-MM), 2012 |
| 会议地点 | 日本 |
| 英文摘要 | Human perception of music and image are highly correlat ed. Both of them can inspire human sensation like emo- tion, power etc. This paper preliminarily investigates how to model the relationship between music and image using 47,888 music-image pairs extracted from music videos. We have two basic observations for this relationship: 1) music s- pace exhibits simpler cluster structure than image space, and 2) the relationship between the two spaces is complex and nonlinear. Based on these observations, we develop Multiple Ranking Canonical Correlation Analysis (MR-CCA) to learn such relationship. MR-CCA clusters the music-image pairs according to their music parts, and then conducts Ranking CCA (R-CCA) for each cluster. Compared with classical CCA, R-CCA takes account of the pairwise ranking infor- mation available in our dataset. MR-CCA improves per- formance and significantly reduce computational cost. Ex- periment results show that R-CCA outperforms CCA, and MR-CCA has the best performance, a consistency score of 84.52% with human labeling. The proposed method can be generalized to model cross media relationship and has po- tential applications in video generation, background music recommendation etc. |
| 收录类别 | 其他 |
| 语种 | 英语 |
| 源URL | [http://ir.siat.ac.cn:8080/handle/172644/3781]  |
| 专题 | 深圳先进技术研究院_集成所 |
| 作者单位 | 2012 |
| 推荐引用方式 GB/T 7714 | Xixuan Wu,Yu Qiao,Xiaogang Wang,et al. Bridging Music and Image:A Preliminary Study with Multiple Ranking CCA Learning[C]. 见:Proc. ACM Multimedia (ACM-MM), 2012. 日本. |
入库方式： OAI收割
来源：深圳先进技术研究院
浏览0
下载0
收藏0
其他版本
除非特别说明，本系统中所有内容都受版权保护，并保留所有权利。