Coded Distributed Computing for System with Stragglers
文献类型：期刊论文
| 作者 | Xu, Jiasheng4; Kang, Huquan3; Zhang, Haonan4; Fu, Luoyi3; Long, Fei2; Cao, Xinde5; Wang, Xinbing(); Zhou, Chenghu1 |
| 刊名 | CHINA COMMUNICATIONS
 |
| 出版日期 | 2025-08-01 |
| 卷号 | 22期号:8页码:298-313 |
| 关键词 | coded computation communication load distributed computing straggling effect |
| ISSN号 | 1673-5447 |
| DOI | 10.23919/JCC.fa.2024-0241.202508 |
| 产权排序 | 5 |
| 文献子类 | Article |
| 英文摘要 | Distributed computing is an important topic in the field of wireless communications and networking, and its high efficiency in handling large amounts of data is particularly noteworthy. Although distributed computing benefits from its ability of processing data in parallel, the communication burden between different servers is incurred, thereby the computation process is detained. Recent researches have applied coding in distributed computing to reduce the communication burden, where repetitive computation is utilized to enable multicast opportunities so that the same coded information can be reused across different servers. To handle the computation tasks in practical heterogeneous systems, we propose a novel coding scheme to effectively mitigate the straggling effect in distributed computing. We assume that there are two types of servers in the system and the only difference between them is their computational capabilities, the servers with lower computational capabilities are called stragglers. Given any ratio of fast servers to slow servers and any gap of computational capabilities between them, we achieve approximately the same computation time for both fast and slow servers by assigning different amounts of computation tasks to them, thus reducing the overall computation time. Furthermore, we investigate the information-theoretic lower bound of the inter-communication load and show that the lower bound is within a constant multiplicative gap to the upper bound achieved by our scheme. Various simulations also validate the effectiveness of the proposed scheme. |
| URL标识 | 查看原文 |
| WOS关键词 | COMPUTATION |
| WOS研究方向 | Telecommunications |
| 语种 | 英语 |
| WOS记录号 | WOS:001571841400019 |
| 出版者 | CHINA INST COMMUNICATIONS |
| 源URL | [http://ir.igsnrr.ac.cn/handle/311030/216047]  |
| 专题 | 资源与环境信息系统国家重点实验室_外文论文 |
| 通讯作者 | Fu, Luoyi |
| 作者单位 | 1.Chinese Acad Sci, Inst Geog Sci & Nat Resources Res, Beijing 100101, Peoples R China 2.Xinhua News Agcy, State Key Lab Media Convergence Prod Technol & Sys, Beijing 100077, Peoples R China; 3.Shanghai Jiao Tong Univ, Dept Comp Sci & Engn, Shanghai 200240, Peoples R China; 4.Shanghai Jiao Tong Univ, Dept Elect Engn, Shanghai 200240, Peoples R China; 5.Shanghai Jiao Tong Univ, Sch Environm Sci & Engn, Shanghai 200240, Peoples R China; |
| 推荐引用方式 GB/T 7714 | Xu, Jiasheng,Kang, Huquan,Zhang, Haonan,et al. Coded Distributed Computing for System with Stragglers[J]. CHINA COMMUNICATIONS,2025,22(8):298-313. |
| APA | Xu, Jiasheng.,Kang, Huquan.,Zhang, Haonan.,Fu, Luoyi.,Long, Fei.,...&Zhou, Chenghu.(2025).Coded Distributed Computing for System with Stragglers.CHINA COMMUNICATIONS,22(8),298-313. |
| MLA | Xu, Jiasheng,et al."Coded Distributed Computing for System with Stragglers".CHINA COMMUNICATIONS 22.8(2025):298-313. |
入库方式： OAI收割
来源：地理科学与资源研究所
浏览0
下载0
收藏0
其他版本
除非特别说明，本系统中所有内容都受版权保护，并保留所有权利。