Toward Network-Aware Query Execution Systems in Large Datacenters
文献类型:期刊论文
作者 | Cheng, Long4; Wang, Ying3; Jhaveri, Rutvij H.2; Wang, Qingle4; Mao, Ying1 |
刊名 | IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT
![]() |
出版日期 | 2023-12-01 |
卷号 | 20期号:4页码:4494-4504 |
关键词 | Query data operator coflow scheduling network communication performance optimizations datacenters |
ISSN号 | 1932-4537 |
DOI | 10.1109/TNSM.2023.3273166 |
英文摘要 | How to efficiently process concurrent data tasks such as online analytical queries in datacenter environments is still a big challenge for current computing techniques. One of the fundamental reasons is that their task execution normally involves large numbers of distributed data operators, which are always expensive in terms of communication time. To improve the general performance, various advanced approaches on the execution optimization of data operators have been proposed in the past years. However, most of them focus on application-level optimization, such as using data locality scheduling to reduce network traffic. Moreover, few of them has considered the optimization opportunities for concurrent execution of multiple data operators. In this paper, we propose a novel coflow-based scheduling system called CoFlop, which aims to improve network communication time for multiple distributed operators at a query level, and on that basis to lay a solid foundation for the development of a network-aware query execution system in datacenter networks. We introduce the detailed system design of CoFlop and conduct a simulation-based evaluation with large concurrent distributed join operations. Compared to existing methods, the experimental results show that CoFlop can perform better in the presence of different large workloads. |
资助项目 | Fundamental Research Funds for the Central Universities |
WOS研究方向 | Computer Science |
语种 | 英语 |
WOS记录号 | WOS:001128152200070 |
出版者 | IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC |
源URL | [http://119.78.100.204/handle/2XEOYT63/38439] ![]() |
专题 | 中国科学院计算技术研究所期刊论文_英文 |
通讯作者 | Jhaveri, Rutvij H. |
作者单位 | 1.Fordham Univ, Dept Comp & Informat Sci, New York, NY 10458 USA 2.Pandit Deendayal Energy Univ, Sch Technol, Dept Comp Sci & Engn, Gandhinagar 382009, India 3.Chinese Acad Sci, Inst Comp Technol, State Key Lab Comp Architecture, Beijing 100190, Peoples R China 4.North China Elect Power Univ, Sch Control & Comp Engn, Beijing 102206, Peoples R China |
推荐引用方式 GB/T 7714 | Cheng, Long,Wang, Ying,Jhaveri, Rutvij H.,et al. Toward Network-Aware Query Execution Systems in Large Datacenters[J]. IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT,2023,20(4):4494-4504. |
APA | Cheng, Long,Wang, Ying,Jhaveri, Rutvij H.,Wang, Qingle,&Mao, Ying.(2023).Toward Network-Aware Query Execution Systems in Large Datacenters.IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT,20(4),4494-4504. |
MLA | Cheng, Long,et al."Toward Network-Aware Query Execution Systems in Large Datacenters".IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT 20.4(2023):4494-4504. |
入库方式: OAI收割
来源:计算技术研究所
浏览0
下载0
收藏0
其他版本
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。