中国科学院机构知识库网格
Chinese Academy of Sciences Institutional Repositories Grid
A BERT-based Heterogeneous Graph Convolution Approach for Mining Organization-Related Topics

文献类型:会议论文

作者Haoda Qian1,2; Minjie Yuan1,2; Qiudan Li1; Daniel Zeng1,2
出版日期2022-07
会议日期2022-07
会议地点Padua, Italy
页码0
英文摘要

 

Mining organization-related topics is helpful to analyze and monitor the information dissemination situation. Existing methods based on heterogeneous graph neural networks mainly consider the association between words and documents, they ignore the semantic interactions between documents, and do not consider the heterogeneity of edges, which are difficult to solve the challenge of blurred topic boundaries in real scenarios, resulting in performance loss. This paper proposes a BERT-based Heterogeneous Graph Convolution Network (BERT-HGCN) approach for semi-supervised topic mining that comprehensively considers multi-semantic relations between words and documents. It deeply combines the advantages of transductive learning with labeled examples and pre-training models. We model documents as graph-structured data and capture the multiple semantic dependencies among word-word, word-doc, and doc-doc via neighborhood propagation. During the model learning process, a two-channel encoding mechanism is used to learn the structure and semantic representations, which fuses a hierarchical graph convolution network (HGCN) and a BERT-based DNN autoencoder. It simultaneously considers edges heterogeneity and semantics of original documents. Finally, a dual-supervised loss function is used to train a classifier based on graph nodes and semantic representations for topic mining. We empirically evaluate the performance of the proposed model on a real-world organization-related dataset, the experimental results demonstrate the efficacy of the model.

语种英语
源URL[http://ir.ia.ac.cn/handle/173211/48609]  
专题自动化研究所_复杂系统管理与控制国家重点实验室_互联网大数据与安全信息学研究中心
作者单位1.The State Key Laboratory of Management and Control for Complex Systems Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China
2.School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing 100049, China
推荐引用方式
GB/T 7714
Haoda Qian,Minjie Yuan,Qiudan Li,et al. A BERT-based Heterogeneous Graph Convolution Approach for Mining Organization-Related Topics[C]. 见:. Padua, Italy. 2022-07.

入库方式: OAI收割

来源:自动化研究所

浏览0
下载0
收藏0
其他版本

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。