中国科学院机构知识库网格
Chinese Academy of Sciences Institutional Repositories Grid
首页 机构 成果 学者
  
  1. CAS IR Grid
  2. 计算技术研究所
  3. 中国科学院计算技术研究所
  4. 中国科学院计算技术研究所期刊论文
  5. 英文
Cognition: Accurate and Consistent Linear Log Parsing Using Template Correction

文献类型：期刊论文

作者Tian, Ran3,4; Diao, Zu-Long2,3; Jiang, Hai-Yang3; Xie, Gao-Gang1,4
刊名JOURNAL OF COMPUTER SCIENCE AND TECHNOLOGY
出版日期2023-09-01
卷号38期号:5页码:1036-1050
关键词log analysis log parsing template correction
ISSN号1000-9000
DOI10.1007/s11390-021-1691-3
英文摘要Logs contain runtime information for both systems and users. As many of them use natural language, a typical log-based analysis needs to parse logs into the structured format first. Existing parsing approaches often take two steps. The first step is to find similar words (tokens) or sentences. Second, parsers extract log templates by replacing different tokens with variable placeholders. However, we observe that most parsers concentrate on precisely grouping similar tokens or logs. But they do not have a well-designed template extraction process, which leads to inconsistent accuracy on particular datasets. The root cause is the ambiguous definition of variable placeholders and similar templates. The consequences include abuse of variable placeholders, incorrectly divided templates, and an excessive number of templates over time. In this paper, we propose our online log parsing approach Cognition. It redefines variable placeholders via a strict lower bound to avoid ambiguity first. Then, it applies our template correction technique to merge and absorb similar templates. It eliminates the interference of commonly used parameters and thus isolates template quantity. Evaluation through 16 public datasets shows that Cognition has better accuracy and consistency than the state-of-the-art approaches. It also saves up to 52.1% of time cost on average than the others.
资助项目National Key Research and Development Program of China[2019YFB1802800] ; National Science Fund for Distinguished Young Scholars of China[61725206]
WOS研究方向Computer Science
语种英语
WOS记录号WOS:001114345700007
出版者SPRINGER SINGAPORE PTE LTD
源URL[http://119.78.100.204/handle/2XEOYT63/38473]  
专题中国科学院计算技术研究所期刊论文_英文
通讯作者Xie, Gao-Gang
作者单位1.Chinese Acad Sci, Comp Network Informat Ctr, Beijing 100083, Peoples R China
2.Purple Mt Labs, Nanjing 211111, Peoples R China
3.Chinese Acad Sci, Inst Comp Technol, Beijing 100190, Peoples R China
4.Univ Chinese Acad Sci, Beijing 100049, Peoples R China
推荐引用方式
GB/T 7714		 Tian, Ran,Diao, Zu-Long,Jiang, Hai-Yang,et al. Cognition: Accurate and Consistent Linear Log Parsing Using Template Correction[J]. JOURNAL OF COMPUTER SCIENCE AND TECHNOLOGY,2023,38(5):1036-1050.
APA Tian, Ran,Diao, Zu-Long,Jiang, Hai-Yang,&Xie, Gao-Gang.(2023).Cognition: Accurate and Consistent Linear Log Parsing Using Template Correction.JOURNAL OF COMPUTER SCIENCE AND TECHNOLOGY,38(5),1036-1050.
MLA Tian, Ran,et al."Cognition: Accurate and Consistent Linear Log Parsing Using Template Correction".JOURNAL OF COMPUTER SCIENCE AND TECHNOLOGY 38.5(2023):1036-1050.

入库方式： OAI收割

来源：计算技术研究所

浏览0
下载0
收藏0
其他版本

除非特别说明，本系统中所有内容都受版权保护，并保留所有权利。