A Migratory HeterogeneityAware Data Layout Scheme for Parallel File Systems
文献类型：会议论文
| 作者 | Shuibing He; Xian-he Sun; Yang Wang; Chengzhong Xu |
| 出版日期 | 2018 |
| 会议日期 | 2018 |
| 会议地点 | 加拿大 |
| 英文摘要 | Parallel file systems (PFSs) are widely deployed to speed up the performance of high-performance computing (HPC) applications. In recent years, hybrid PFSs that consist of HDD-SSD servers, have attracted much attention in HPC community. However, existing data layout schemes do not well consider the characteristics of heterogeneous servers and heterogeneous access patterns, thus may experience considerable inefficiencies. In this study, we propose MHA, a migratory heterogeneity-aware data layout scheme to improve the data distribution of hybrid PFS. More specifically, to accommodate heterogeneous access patterns, MHA first migrates file data into several regions, each with similar access patterns. Then, by leveraging a data access cost model, MHA determines the appropriate stripe sizes on heterogeneous servers to get the best performance on each region. We have implemented MHA under MPI-IO library on top of OrangeFS file system. Experimental results show that MHA can significantly improve the hybrid PFS I/O system performance compared to existing data layout schemes. |
| 语种 | 英语 |
| URL标识 | 查看原文 |
| 源URL | [http://ir.siat.ac.cn:8080/handle/172644/14128]  |
| 专题 | 深圳先进技术研究院_数字所 |
| 推荐引用方式 GB/T 7714 | Shuibing He,Xian-he Sun,Yang Wang,et al. A Migratory HeterogeneityAware Data Layout Scheme for Parallel File Systems[C]. 见:. 加拿大. 2018. |
入库方式： OAI收割
来源：深圳先进技术研究院
浏览0
下载0
收藏0
其他版本
除非特别说明，本系统中所有内容都受版权保护，并保留所有权利。