中国科学院机构知识库网格
Chinese Academy of Sciences Institutional Repositories Grid
首页 机构 成果 学者
  
  1. CAS IR Grid
  2. 自动化研究所
  3. 中国科学院自动化研究所
  4. 多模态人工智能系统全国重点实验室
  5. 自然语言处理
Using Pre-trained Language Model to Enhance Active Learning for Sentence Matching

文献类型：期刊论文

作者Bai, Guirong1,2; He, Shizhu1,2; Liu, Kang1,2; Zhao, Jun1,2
刊名ACM TRANSACTIONS ON ASIAN AND LOW-RESOURCE LANGUAGE INFORMATION PROCESSING
出版日期2022-03-01
卷号21期号:2页码:19
关键词Sentence matching active learning pre-trained language model
ISSN号2375-4699
DOI10.1145/3480937
通讯作者Bai, Guirong(guirong.bai@nlpr.ia.ac.cn)
英文摘要Active learning is an effective method to substantially alleviate the problem of expensive annotation cost for data-driven models. Recently, pre-trained language models have been demonstrated to be powerful for learning language representations. In this article, we demonstrate that the pre-trained language model can also utilize its learned textual characteristics to enrich criteria of active learning. Specifically, we provide extra textual criteria with the pre-trained language model to measure instances, including noise, coverage, and diversity. With these extra textual criteria, we can select more efficient instances for annotation and obtain better results. We conduct experiments on both English and Chinese sentence matching datasets. The experimental results show that the proposed active learning approach can be enhanced by the pre-trained language model and obtain better performance.
资助项目National Natural Science Foundation of China[61976211] ; National Natural Science Foundation of China[61922085] ; Beijing Academy of Artifcial Intelligence[BAAI2019QN0301] ; Key Research Program of the Chinese Academy of Sciences[ZDBS-SSW-JSC006] ; independent research project of the National Laboratory of Pattern Recognition, China ; Youth Innovation Promotion Association CAS, China
WOS研究方向Computer Science
语种英语
WOS记录号WOS:000775466500021
出版者ASSOC COMPUTING MACHINERY
资助机构National Natural Science Foundation of China ; Beijing Academy of Artifcial Intelligence ; Key Research Program of the Chinese Academy of Sciences ; independent research project of the National Laboratory of Pattern Recognition, China ; Youth Innovation Promotion Association CAS, China
源URL[http://ir.ia.ac.cn/handle/173211/48195]  
专题模式识别国家重点实验室_自然语言处理
通讯作者Bai, Guirong
作者单位1.Univ Chinese Acad Sci, Sch Artificial Intelligence, 95 Zhongguancun East Rd, Beijing 100190, Peoples R China
2.Chinese Acad Sci, Natl Lab Pattern Recognit, Inst Automat, 95 Zhongguancun East Rd, Beijing 100190, Peoples R China
推荐引用方式
GB/T 7714		 Bai, Guirong,He, Shizhu,Liu, Kang,et al. Using Pre-trained Language Model to Enhance Active Learning for Sentence Matching[J]. ACM TRANSACTIONS ON ASIAN AND LOW-RESOURCE LANGUAGE INFORMATION PROCESSING,2022,21(2):19.
APA Bai, Guirong,He, Shizhu,Liu, Kang,&Zhao, Jun.(2022).Using Pre-trained Language Model to Enhance Active Learning for Sentence Matching.ACM TRANSACTIONS ON ASIAN AND LOW-RESOURCE LANGUAGE INFORMATION PROCESSING,21(2),19.
MLA Bai, Guirong,et al."Using Pre-trained Language Model to Enhance Active Learning for Sentence Matching".ACM TRANSACTIONS ON ASIAN AND LOW-RESOURCE LANGUAGE INFORMATION PROCESSING 21.2(2022):19.

入库方式： OAI收割

来源：自动化研究所

浏览0
下载0
收藏0
其他版本

除非特别说明，本系统中所有内容都受版权保护，并保留所有权利。