BPR: An Erasure Coding Batch Parallel Repair Approach in Distributed Storage Systems
文献类型：期刊论文
| 作者 | Song, Ying1,3,4; Zhao, Wenxuan3,4; Wang, Bo2 |
| 刊名 | IEEE ACCESS
 |
| 出版日期 | 2023 |
| 卷号 | 11页码:44509-44518 |
| 关键词 | Distributed processing Business process re-engineering Traffic congestion Encoding Full-duplex system Decoding Bandwidth Storage management Distributed storage system erasure coding data recovery |
| ISSN号 | 2169-3536 |
| DOI | 10.1109/ACCESS.2023.3257404 |
| 英文摘要 | Today, Erasure Coding is one of the most significant techniques widely used in distributed systems because it can improve reliability for large amounts of data with low storage overhead. However, when the distributed system encounters a large number of data loss in stripes and requires batch-stripes data recovery, current data recovery methods either repeat the single-stripe recovery method or only optimize partial stripe recovery when recovering large-scale stripes, which incurs heavy upload and download repair traffics and imbalanced load, affecting the efficiency of fault recovery and wasting additional resources. In this paper, we propose BPR, an Erasure Coding batch parallel repair approach for distributed storage systems. BPR reduces cross-rack network transfer time and increases recovery throughput by classifying the stripes and recovering the data of stripes in batches through the forward and reverse parallel data recovery. The experiment results show that for large-scale stripes recovery, BPR reduces the cross-rack network transfer time by up to 10% and increases the recovery throughput by up to 8% compared with the rPDL in some scenarios. |
| 资助项目 | National Natural Science Foundation of China[61872043] ; State Key Laboratory of Computer Architecture, Institute of Computing Technology (ICT), Chinese Academy of Sciences (CAS)[CARCHA202103] |
| WOS研究方向 | Computer Science ; Engineering ; Telecommunications |
| 语种 | 英语 |
| WOS记录号 | WOS:000988464100001 |
| 出版者 | IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC |
| 源URL | [http://119.78.100.204/handle/2XEOYT63/21455]  |
| 专题 | 中国科学院计算技术研究所期刊论文_英文 |
| 通讯作者 | Song, Ying |
| 作者单位 | 1.Chinese Acad Sci, Inst Comp Technol, State Key Lab Comp Architecture, Beijing 100086, Peoples R China 2.Zhengzhou Univ Light Ind, Software Engn Coll, Zhengzhou 450002, Peoples R China 3.Beijing Informat Sci & Technol Univ, Beijing Adv Innovat Ctr Mat Genome Engn, Beijing 100101, Peoples R China 4.Beijing Informat Sci & Technol Univ, Beijing Key Lab Internet Culture & Digital Dissemi, Beijing 100101, Peoples R China |
| 推荐引用方式 GB/T 7714 | Song, Ying,Zhao, Wenxuan,Wang, Bo. BPR: An Erasure Coding Batch Parallel Repair Approach in Distributed Storage Systems[J]. IEEE ACCESS,2023,11:44509-44518. |
| APA | Song, Ying,Zhao, Wenxuan,&Wang, Bo.(2023).BPR: An Erasure Coding Batch Parallel Repair Approach in Distributed Storage Systems.IEEE ACCESS,11,44509-44518. |
| MLA | Song, Ying,et al."BPR: An Erasure Coding Batch Parallel Repair Approach in Distributed Storage Systems".IEEE ACCESS 11(2023):44509-44518. |
入库方式： OAI收割
来源：计算技术研究所
浏览0
下载0
收藏0
其他版本
除非特别说明，本系统中所有内容都受版权保护，并保留所有权利。