Exploiting Stream Request Locality to Improve Query Throughput of a Data Integration System
文献类型：期刊论文
| 作者 | Lee, Rubao; Xu, Zhiwei |
| 刊名 | IEEE TRANSACTIONS ON COMPUTERS
 |
| 出版日期 | 2009-10-01 |
| 卷号 | 58期号:10页码:1356-1368 |
| 关键词 | Buffer management distributed databases locality query processing |
| ISSN号 | 0018-9340 |
| DOI | 10.1109/TC.2009.80 |
| 英文摘要 | This paper focuses on the problem of improving throughput of distributed query processing in an RDBMS-based data integration system. Although a buffer pool can be used in an RDBMS to cache disk pages in memory to reduce disk accesses, it cannot be used for data integration queries since its foundation, the memory-disk hierarchy, does not exist. The lack of a data sharing mechanism limits system throughput because unnecessary data requests increase burden on data sources and redundant resultant data transfers waste network bandwidth. To address the problem, we present a new technique called request window, which can detect and exploit data sharing opportunities among concurrent queries. Request window exploits a new stream request locality which reflects common query interests among independent users in a short time period. The existence of such a locality makes it possible to collect a group of related data requests and process them as a batch by request window. Evaluation on a PostgreSQL-based data integration system shows that request window can significantly increase system throughput when running a distributed TPC-H workload. |
| 资助项目 | National Science Foundation of China[90412010] ; Hi-Tech Research and Development (863) Program of China[2006AA01A106] ; National Basic Research (973) Program of China[2005CB321807] |
| WOS研究方向 | Computer Science ; Engineering |
| 语种 | 英语 |
| WOS记录号 | WOS:000269131900006 |
| 出版者 | IEEE COMPUTER SOC |
| 源URL | [http://119.78.100.204/handle/2XEOYT63/11837]  |
| 专题 | 中国科学院计算技术研究所期刊论文_英文 |
| 通讯作者 | Lee, Rubao |
| 作者单位 | Chinese Acad Sci, Inst Comp Technol, Beijing 100080, Peoples R China |
| 推荐引用方式 GB/T 7714 | Lee, Rubao,Xu, Zhiwei. Exploiting Stream Request Locality to Improve Query Throughput of a Data Integration System[J]. IEEE TRANSACTIONS ON COMPUTERS,2009,58(10):1356-1368. |
| APA | Lee, Rubao,&Xu, Zhiwei.(2009).Exploiting Stream Request Locality to Improve Query Throughput of a Data Integration System.IEEE TRANSACTIONS ON COMPUTERS,58(10),1356-1368. |
| MLA | Lee, Rubao,et al."Exploiting Stream Request Locality to Improve Query Throughput of a Data Integration System".IEEE TRANSACTIONS ON COMPUTERS 58.10(2009):1356-1368. |
入库方式： OAI收割
来源：计算技术研究所
浏览0
下载0
收藏0
其他版本
除非特别说明，本系统中所有内容都受版权保护，并保留所有权利。