中国科学院机构知识库网格
Chinese Academy of Sciences Institutional Repositories Grid
首页 机构 成果 学者
  
  1. CAS IR Grid
  2. 计算技术研究所
  3. 中国科学院计算技术研究所
  4. 中国科学院计算技术研究所期刊论文
  5. 英文
A Seed-Based Method for Generating Chinese Confusion Sets

文献类型：期刊论文

作者Liu, Liangliang1; Cao, Cungen2
刊名ACM TRANSACTIONS ON ASIAN AND LOW-RESOURCE LANGUAGE INFORMATION PROCESSING
出版日期2016-12-01
卷号16期号:1页码:16
关键词Confusion set pattern matching context probability pinyin similarity shape similarity
ISSN号2375-4699
DOI10.1145/2933396
英文摘要In natural language, people often misuse a word (called a "confused word") in place of other words (called "confusing words"). In misspelling corrections, many approaches to finding and correcting misspelling errors are based on a simple notion called a "confusion set." The confusion set of a confused word consists of confusing words. In this article, we propose a new method of building Chinese character confusion sets. Our method is composed of two major phases. In the first phase, we build a list of seed confusion sets for each Chinese character, which is based on measuring similarity in character pinyin or similarity in character shape. In this phase, all confusion sets are constructed manually, and the confusion sets are organized into a graph, called a "seed confusion graph" (SCG), in which vertices denote characters and edges are pairs of characters in the form (confused character, confusing character). In the second phase, we extend the SCG by acquiring more pairs of (confused character, confusing character) from a large Chinese corpus. For this, we use several word patterns (or patterns) to generate new confusion pairs and then verify the pairs before adding them into a SCG. Comprehensive experiments show that our method of extending confusion sets is effective. Also, we shall use the confusion sets in Chinese misspelling corrections to show the utility of our method.
资助项目National Natural Science Foundation of China[91224006] ; National Natural Science Foundation of China[61173063] ; Ministry of Science and Technology of China[201303107]
WOS研究方向Computer Science
语种英语
WOS记录号WOS:000391438500005
出版者ASSOC COMPUTING MACHINERY
源URL[http://119.78.100.204/handle/2XEOYT63/7714]  
专题中国科学院计算技术研究所期刊论文_英文
通讯作者Liu, Liangliang
作者单位1.Shanghai Univ Int Business & Econ, Sch Business Informat, Shanghai 201620, Peoples R China
2.Chinese Acad Sci, Inst Comp Technol, Key Lab Intelligent Informat Proc, Beijing 100190, Peoples R China
推荐引用方式
GB/T 7714		 Liu, Liangliang,Cao, Cungen. A Seed-Based Method for Generating Chinese Confusion Sets[J]. ACM TRANSACTIONS ON ASIAN AND LOW-RESOURCE LANGUAGE INFORMATION PROCESSING,2016,16(1):16.
APA Liu, Liangliang,&Cao, Cungen.(2016).A Seed-Based Method for Generating Chinese Confusion Sets.ACM TRANSACTIONS ON ASIAN AND LOW-RESOURCE LANGUAGE INFORMATION PROCESSING,16(1),16.
MLA Liu, Liangliang,et al."A Seed-Based Method for Generating Chinese Confusion Sets".ACM TRANSACTIONS ON ASIAN AND LOW-RESOURCE LANGUAGE INFORMATION PROCESSING 16.1(2016):16.

入库方式： OAI收割

来源：计算技术研究所

浏览0
下载0
收藏0
其他版本

除非特别说明，本系统中所有内容都受版权保护，并保留所有权利。