Cost-Aware Region-Level Data Placement in Multi-Tiered Parallel I/O Systems
文献类型：期刊论文
| 作者 | Shuibing He; Yang Wang; Zhen Li; Xian-He Sun; Chengzhong Xu |
| 刊名 | IEEE Transactions on Parallel and Distributed Systems
 |
| 出版日期 | 2017 |
| 文献子类 | 期刊论文 |
| 英文摘要 | Multi-tiered Parallel I/O systems that combine traditional HDDs with emerging SSDs mitigate the cost burden of SSDs while benefiting from their superior I/O performance. While a multi-tiered parallel I/O system is promising for data-intensive applications in high-performance (HPC) domains, placing data on each tier of the system to achieve high I/O performance remains a challenge. In this paper, we propose a cost-aware region-level (CARL) data placement scheme in multi-tiered parallel I/O systems. CARL divides a large file into several small regions, and then places regions on different types of servers based on region access costs. CARL includes a static policy S-CARL and a dynamic policy D-CARL. For applications whose I/O access patterns are completely known, S-CARL calculates the region costs within the entire workload duration, and uses a static data placement scheme to selectively place regions on the proper servers. To adapt to applications whose access patterns are unknown in advance, D-CARL uses a dynamic data placement scheme which migrates data among different servers within each time window. We have implemented CARL under MPI-IO library and OrangeFS parallel file system environment. Our evaluation with representative benchmarks and an application shows that CARL is both feasible and able to improve I/O performance significantly. |
| URL标识 | 查看原文 |
| 语种 | 英语 |
| 源URL | [http://ir.siat.ac.cn:8080/handle/172644/12521]  |
| 专题 | 深圳先进技术研究院_数字所 |
| 作者单位 | IEEE Transactions on Parallel and Distributed Systems |
| 推荐引用方式 GB/T 7714 | Shuibing He,Yang Wang,Zhen Li,et al. Cost-Aware Region-Level Data Placement in Multi-Tiered Parallel I/O Systems[J]. IEEE Transactions on Parallel and Distributed Systems,2017. |
| APA | Shuibing He,Yang Wang,Zhen Li,Xian-He Sun,&Chengzhong Xu.(2017).Cost-Aware Region-Level Data Placement in Multi-Tiered Parallel I/O Systems.IEEE Transactions on Parallel and Distributed Systems. |
| MLA | Shuibing He,et al."Cost-Aware Region-Level Data Placement in Multi-Tiered Parallel I/O Systems".IEEE Transactions on Parallel and Distributed Systems (2017). |
入库方式： OAI收割
来源：深圳先进技术研究院
浏览0
下载0
收藏0
其他版本
除非特别说明，本系统中所有内容都受版权保护，并保留所有权利。