中国科学院机构知识库网格
Chinese Academy of Sciences Institutional Repositories Grid
首页 机构 成果 学者
  
  1. CAS IR Grid
  2. 自动化研究所
  3. 中国科学院自动化研究所
  4. 学术期刊
  5. International Journal of Automation and Computing
DynamicRetriever: A Pre-trained Model-based IR System Without an Explicit Index

文献类型：期刊论文

作者Yu-Jia Zhou1; Jing Yao1; Zhi-Cheng Dou1; Ledell Wu2; Ji-Rong Wen1
刊名Machine Intelligence Research
出版日期2023
卷号20期号:2页码:276-288
关键词Information retrieval (IR) document retrieval model-based IR pre-trained language model differentiable search index
ISSN号2731-538X
DOI10.1007/s11633-022-1373-9
英文摘要Web search provides a promising way for people to obtain information and has been extensively studied. With the surge of deep learning and large-scale pre-training techniques, various neural information retrieval models are proposed, and they have demonstrated the power for improving search (especially, the ranking) quality. All these existing search methods follow a common paradigm, i.e., index-retrieve-rerank, where they first build an index of all documents based on document terms (i.e., sparse inverted index) or representation vectors (i.e., dense vector index), then retrieve and rerank retrieved documents based on the similarity between the query and documents via ranking models. In this paper, we explore a new paradigm of information retrieval without an explicit index but only with a pre-trained model. Instead, all of the knowledge of the documents is encoded into model parameters, which can be regarded as a differentiable indexer and optimized in an end-to-end manner. Specifically, we propose a pre-trained model-based information retrieval (IR) system called DynamicRetriever, which directly returns document identifiers for a given query. Under such a framework, we implement two variants to explore how to train the model from scratch and how to combine the advantages of dense retrieval models. Compared with existing search methods, the model-based IR system parameterizes the traditional static index with a pre-training model, which converts the document semantic mapping into a dynamic and updatable process. Extensive experiments conducted on the public search benchmark Microsoft machine reading comprehension (MS MARCO) verify the effectiveness and potential of our proposed new paradigm for information retrieval.
源URL[http://ir.ia.ac.cn/handle/173211/55980]  
专题自动化研究所_学术期刊_International Journal of Automation and Computing
作者单位1.Gaoling School of Artificial Intelligence, Renmin University of China, Beijing 100872, China
2.Beijing Academy of Artificial Intelligence, Beijing 100084, China
推荐引用方式
GB/T 7714		 Yu-Jia Zhou,Jing Yao,Zhi-Cheng Dou,et al. DynamicRetriever: A Pre-trained Model-based IR System Without an Explicit Index[J]. Machine Intelligence Research,2023,20(2):276-288.
APA Yu-Jia Zhou,Jing Yao,Zhi-Cheng Dou,Ledell Wu,&Ji-Rong Wen.(2023).DynamicRetriever: A Pre-trained Model-based IR System Without an Explicit Index.Machine Intelligence Research,20(2),276-288.
MLA Yu-Jia Zhou,et al."DynamicRetriever: A Pre-trained Model-based IR System Without an Explicit Index".Machine Intelligence Research 20.2(2023):276-288.

入库方式： OAI收割

来源：自动化研究所

浏览0
下载0
收藏0
其他版本

除非特别说明，本系统中所有内容都受版权保护，并保留所有权利。