中国科学院机构知识库网格
Chinese Academy of Sciences Institutional Repositories Grid
Fake News Detection via Multi-Modal Topic Memory Network

文献类型:期刊论文

作者Ying, Long1; Yu, Hui1; Wang, Jinguang2; Ji, Yongze3; Qian, Shengsheng4
刊名IEEE ACCESS
出版日期2021
卷号9页码:132818-132829
关键词Feature extraction Semantics Social networking (online) Visualization Data mining Task analysis Training data Fake news detection multi-modal fusion topic memory network blended attention module
ISSN号2169-3536
DOI10.1109/ACCESS.2021.3113981
通讯作者Wang, Jinguang(wangjinguang502@gmail.com) ; Qian, Shengsheng(shengsheng.qian@nlpr.ia.ac.cn)
英文摘要With the development of the Mobile Internet, more and more people create and release multi-modal posts on social media platforms. Fake news detection has become an increasingly challenging task. Although many current works focus on constructing models extracting abstract features from the content of each post, they neglect the intrinsic semantic architecture such as latent topics, etc. These models only learn patterns in content coupled with certain specific latent topics on the training set to distinguish real and fake posts, which will suffer generalization and discriminating ability decline, especially when posts are associated with rare or new topics. Moreover, most existing works using deep schemes to extract and integrate textual and visual representation in post have not effectively modeled and sufficiently utilized the complementary and noisy multi-modal information containing semantic concepts and entities to complement and enhance each modal. In this paper, to deal with the above problems, we propose a novel end-to-end Multi-modal Topic Memory Network (MTMN), which obtains and combines post representations shared across latent topics together with global features of latent topics while modeling intra-modality and inter-modality information in a unified framework. (1) To tackle real scenarios where newly arriving posts with different topic distribution from the training data, our method incorporates a topic memory module to explicitly characterize final representation as post feature shared across topics and global features of latent topics. These two kinds of features are jointly learned and then combined to generate robust representation. (2) To effectively integrate multi-modality information in posts, we propose a novel blended attention module for multi-modal fusion, which can simultaneously exploit the intra-modality relation within each modal and the inter-modality relation between text words and image regions to complement and enhance each other for high-quality representation. Extensive experiments on two public real-world datasets demonstrate the superior performance of MTMN compared with other state-of-the-art algorithms.
资助项目National Natural Science Foundation of China[61902193] ; Priority Academic Program Development of Jiangsu Higher Education Institutions (PAPD)
WOS研究方向Computer Science ; Engineering ; Telecommunications
语种英语
WOS记录号WOS:000702541200001
出版者IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
资助机构National Natural Science Foundation of China ; Priority Academic Program Development of Jiangsu Higher Education Institutions (PAPD)
源URL[http://ir.ia.ac.cn/handle/173211/45783]  
专题自动化研究所_模式识别国家重点实验室_多媒体计算与图形学团队
通讯作者Wang, Jinguang; Qian, Shengsheng
作者单位1.Nanjing Univ Informat Sci & Technol, Sch Comp & Software, Nanjing 210044, Peoples R China
2.Hefei Univ Technol, Sch Comp Sci & Informat Engn, Hefei 230601, Peoples R China
3.China Univ Petr, Sch Informat Sci & Engn, Beijing 102249, Peoples R China
4.Chinese Acad Sci, Inst Automat, Natl Lab Pattern Recognit, Beijing 100190, Peoples R China
推荐引用方式
GB/T 7714
Ying, Long,Yu, Hui,Wang, Jinguang,et al. Fake News Detection via Multi-Modal Topic Memory Network[J]. IEEE ACCESS,2021,9:132818-132829.
APA Ying, Long,Yu, Hui,Wang, Jinguang,Ji, Yongze,&Qian, Shengsheng.(2021).Fake News Detection via Multi-Modal Topic Memory Network.IEEE ACCESS,9,132818-132829.
MLA Ying, Long,et al."Fake News Detection via Multi-Modal Topic Memory Network".IEEE ACCESS 9(2021):132818-132829.

入库方式: OAI收割

来源:自动化研究所

浏览0
下载0
收藏0
其他版本

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。