中国科学院机构知识库网格
Chinese Academy of Sciences Institutional Repositories Grid
Efficient knowledge graph to text powered by LLGM: linear latent graph model

文献类型:期刊论文

作者Zhao, Xiaokang4; Zheng, Yao3; Shan, Yubo3; Li, Jingyuan4; Zhang, Kun2; Wang, Yuanzhuo1
刊名COMPLEX & INTELLIGENT SYSTEMS
出版日期2025-08-01
卷号11期号:8页码:22
关键词Knowledge graph to text generation Linear attention Low rank compression Fourier network
ISSN号2199-4536
DOI10.1007/s40747-025-01985-8
英文摘要Knowledge graph to text generation is crucial for interpreting complex structured data, yet state-of-the-art transformer models face significant computational burdens, limiting their practical deployment. This paper introduces the Linear Latent Graph Model (LLGM), a novel architecture that significantly enhances efficiency in KG-to-text generation without compromising performance. LLGM's core innovations are three-fold: (1) a Multi-head Statistical Attention (MSA) mechanism that achieves linear O(N) complexity by replacing pairwise token interactions with efficient statistical approximations, drastically reducing the primary computational bottleneck; (2) a Graph Latent Self-Attention (GLSA) module that efficiently encodes explicit graph structures using dimension-reduced intermediate representations, preserving relational fidelity with fewer parameters; and (3) a Graph Periodicity Projector (GPP) that optimizes feed-forward networks by decomposing representations into periodic and non-periodic components, adeptly capturing both regular and unique graph patterns. Experiments on the WebNLG and EventNarrative datasets demonstrate LLGM's significant contributions: it achieves competitive text generation quality, evidenced by a mere 0.8% BLEU-4 gap to the top model and the highest CIDEr score (4.63) on WebNLG, while requiring 20-37% fewer parameters than leading models. LLGM offers a robust and scalable solution, effectively bridging the efficiency-effectiveness gap in KG-to-text generation and enabling broader application in resource-constrained environments.
资助项目National Natural Science Foundation of China[62172393] ; Henan Province Key Research and Development Project[241111211900]
WOS研究方向Computer Science
语种英语
WOS记录号WOS:001510573200009
出版者SPRINGER HEIDELBERG
源URL[http://119.78.100.204/handle/2XEOYT63/42365]  
专题中国科学院计算技术研究所期刊论文_英文
通讯作者Li, Jingyuan
作者单位1.Chinese Acad Sci, Inst Comp Technol, Beijing, Peoples R China
2.Tencent Inc, Pattern Recognit Ctr, WeChat AI, Beijing, Peoples R China
3.Zhengzhou Univ, Henan Inst Adv Technol, Zhengzhou, Peoples R China
4.Beijing Technol & Business Univ, Sch Comp & Artificial Intelligence, Beijing 100048, Peoples R China
推荐引用方式
GB/T 7714
Zhao, Xiaokang,Zheng, Yao,Shan, Yubo,et al. Efficient knowledge graph to text powered by LLGM: linear latent graph model[J]. COMPLEX & INTELLIGENT SYSTEMS,2025,11(8):22.
APA Zhao, Xiaokang,Zheng, Yao,Shan, Yubo,Li, Jingyuan,Zhang, Kun,&Wang, Yuanzhuo.(2025).Efficient knowledge graph to text powered by LLGM: linear latent graph model.COMPLEX & INTELLIGENT SYSTEMS,11(8),22.
MLA Zhao, Xiaokang,et al."Efficient knowledge graph to text powered by LLGM: linear latent graph model".COMPLEX & INTELLIGENT SYSTEMS 11.8(2025):22.

入库方式: OAI收割

来源:计算技术研究所

浏览0
下载0
收藏0
其他版本

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。