Automatic construction of classification dimensions by clustering texts based on common words
文献类型:期刊论文
作者 | Ma, Bing2,3; Zhuge, Hai1 |
刊名 | EXPERT SYSTEMS WITH APPLICATIONS
![]() |
出版日期 | 2024-03-15 |
卷号 | 238页码:14 |
关键词 | Natural Language Processing Hierarchical Classification Dimension Text Summarization Text Clustering |
ISSN号 | 0957-4174 |
DOI | 10.1016/j.eswa.2023.122292 |
英文摘要 | A way to efficiently manage large sets of texts is to construct multiple dimensions on texts and manage the texts from the dimensions. The key problem is to use a suitable representation model of text to classify texts into class trees representing dimensions. Traditional vector-based distance definitions are unsuitable to restrict the semantic relations between texts and measure the similarity of a set of more than two texts. Frequently occurred common words within a set of texts represent the texts but traditional frequent-term-set based text clustering approaches and the topic model are unsuitable for generating class trees on texts. This paper proposes an approach to using common words to represent texts and measuring the similarity of a class of texts by calculating the sum of the weights of common words of the class that indicate the common semantics of these texts. The idea is in line with the characteristics of human classification of texts. A bottom-up text clustering approach is proposed to construct class trees of texts. The common words of each class on the class trees are used as the label of the class to indicate the common semantics of the class and manage the texts of the class. Therefore, the approach can be used to construct multiple classification trees on texts. The experiments for evaluating the classification accuracy and the structure of the constructed class trees show that our approach is better than other clustering algorithms. A document summarization approach based on our approach reaches a good performance. |
资助项目 | National Natural Science Foundation of China[61876048] |
WOS研究方向 | Computer Science ; Engineering ; Operations Research & Management Science |
语种 | 英语 |
WOS记录号 | WOS:001105524300001 |
出版者 | PERGAMON-ELSEVIER SCIENCE LTD |
源URL | [http://119.78.100.204/handle/2XEOYT63/38083] ![]() |
专题 | 中国科学院计算技术研究所期刊论文_英文 |
通讯作者 | Zhuge, Hai |
作者单位 | 1.Great Bay Univ, Dongguan, Peoples R China 2.Univ Chinese Acad Sci, Beijing, Peoples R China 3.Chinese Acad Sci, Inst Comp Technol, Key Lab Intelligent Informat Proc, Beijing, Peoples R China |
推荐引用方式 GB/T 7714 | Ma, Bing,Zhuge, Hai. Automatic construction of classification dimensions by clustering texts based on common words[J]. EXPERT SYSTEMS WITH APPLICATIONS,2024,238:14. |
APA | Ma, Bing,&Zhuge, Hai.(2024).Automatic construction of classification dimensions by clustering texts based on common words.EXPERT SYSTEMS WITH APPLICATIONS,238,14. |
MLA | Ma, Bing,et al."Automatic construction of classification dimensions by clustering texts based on common words".EXPERT SYSTEMS WITH APPLICATIONS 238(2024):14. |
入库方式: OAI收割
来源:计算技术研究所
浏览0
下载0
收藏0
其他版本
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。