中国科学院机构知识库网格
Chinese Academy of Sciences Institutional Repositories Grid
Toward Network-Aware Query Execution Systems in Large Datacenters

文献类型:期刊论文

作者Cheng, Long4; Wang, Ying3; Jhaveri, Rutvij H.2; Wang, Qingle4; Mao, Ying1
刊名IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT
出版日期2023-12-01
卷号20期号:4页码:4494-4504
关键词Query data operator coflow scheduling network communication performance optimizations datacenters
ISSN号1932-4537
DOI10.1109/TNSM.2023.3273166
英文摘要How to efficiently process concurrent data tasks such as online analytical queries in datacenter environments is still a big challenge for current computing techniques. One of the fundamental reasons is that their task execution normally involves large numbers of distributed data operators, which are always expensive in terms of communication time. To improve the general performance, various advanced approaches on the execution optimization of data operators have been proposed in the past years. However, most of them focus on application-level optimization, such as using data locality scheduling to reduce network traffic. Moreover, few of them has considered the optimization opportunities for concurrent execution of multiple data operators. In this paper, we propose a novel coflow-based scheduling system called CoFlop, which aims to improve network communication time for multiple distributed operators at a query level, and on that basis to lay a solid foundation for the development of a network-aware query execution system in datacenter networks. We introduce the detailed system design of CoFlop and conduct a simulation-based evaluation with large concurrent distributed join operations. Compared to existing methods, the experimental results show that CoFlop can perform better in the presence of different large workloads.
资助项目Fundamental Research Funds for the Central Universities
WOS研究方向Computer Science
语种英语
WOS记录号WOS:001128152200070
出版者IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
源URL[http://119.78.100.204/handle/2XEOYT63/38439]  
专题中国科学院计算技术研究所期刊论文_英文
通讯作者Jhaveri, Rutvij H.
作者单位1.Fordham Univ, Dept Comp & Informat Sci, New York, NY 10458 USA
2.Pandit Deendayal Energy Univ, Sch Technol, Dept Comp Sci & Engn, Gandhinagar 382009, India
3.Chinese Acad Sci, Inst Comp Technol, State Key Lab Comp Architecture, Beijing 100190, Peoples R China
4.North China Elect Power Univ, Sch Control & Comp Engn, Beijing 102206, Peoples R China
推荐引用方式
GB/T 7714
Cheng, Long,Wang, Ying,Jhaveri, Rutvij H.,et al. Toward Network-Aware Query Execution Systems in Large Datacenters[J]. IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT,2023,20(4):4494-4504.
APA Cheng, Long,Wang, Ying,Jhaveri, Rutvij H.,Wang, Qingle,&Mao, Ying.(2023).Toward Network-Aware Query Execution Systems in Large Datacenters.IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT,20(4),4494-4504.
MLA Cheng, Long,et al."Toward Network-Aware Query Execution Systems in Large Datacenters".IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT 20.4(2023):4494-4504.

入库方式: OAI收割

来源:计算技术研究所

浏览0
下载0
收藏0
其他版本

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。