HWM: a hybrid workload migration mechanism of metadata server cluster in data center
文献类型：期刊论文
| 作者 | Liu, Jian1,2; Dong, Huanqing2; Zhang, Junwei2; Liu, Zhenjun2; Xu, Lu2 |
| 刊名 | FRONTIERS OF COMPUTER SCIENCE
 |
| 出版日期 | 2017-02-01 |
| 卷号 | 11期号:1页码:75-87 |
| 关键词 | data center metadata server cluster hybrid workload migration metadata service state service low-latency access |
| ISSN号 | 2095-2228 |
| DOI | 10.1007/s11704-016-6036-y |
| 英文摘要 | In data center, applications of big data analytics pose a big challenge to massive storage systems. It is significant to achieve high availability, high performance and high scalability for PB-scale or EB-scale storage systems. Metadata server (MDS) cluster architecture is one of the most effective solutions to meet the requirements of applications in data center. Workload migration can achieve load balance and energy saving of cluster systems. In this paper, a hybrid workload migration mechanism of MDS cluster is proposed and named as HWM. In HWM, workload of MDS is classified into two categories: metadata service and state service, and they can be migrated rapidly from a source MDS to a target MDS in different ways. Firstly, in metadata service migration, all the dirty metadata of one sub file system is flushed to a shared storage pool by the source MDS, and then is loaded by the target MDS. Secondly, in state service migration, all the states of that sub file system are migrated from source MDS to target MDS through network at file granularity, and then all of the related structures of these states are reconstructed in targetMDS. Thirdly, in the process of workload migration, instead of blocking client requests, the source MDS can decide which MDS will respond to each request according to the operation type and the migration stage. The proposed mechanismis implemented in the BlueWhaleMDS cluster. The performance measurements show that the HWM mechanism is efficient to migrate the workload of a MDS cluster system and provides low-latency access to metadata and states. |
| 资助项目 | Chinese Academy of Sciences[XDA06010401] ; Tianjin Science and Technology Program[15ZXDSGX00020] |
| WOS研究方向 | Computer Science |
| 语种 | 英语 |
| WOS记录号 | WOS:000393581400008 |
| 出版者 | HIGHER EDUCATION PRESS |
| 源URL | [http://119.78.100.204/handle/2XEOYT63/7585]  |
| 专题 | 中国科学院计算技术研究所期刊论文_英文 |
| 通讯作者 | Xu, Lu |
| 作者单位 | 1.Univ Chinese Acad Sci, Beijing 100049, Peoples R China 2.Chinese Acad Sci, Inst Comp Technol, Beijing 100190, Peoples R China |
| 推荐引用方式 GB/T 7714 | Liu, Jian,Dong, Huanqing,Zhang, Junwei,et al. HWM: a hybrid workload migration mechanism of metadata server cluster in data center[J]. FRONTIERS OF COMPUTER SCIENCE,2017,11(1):75-87. |
| APA | Liu, Jian,Dong, Huanqing,Zhang, Junwei,Liu, Zhenjun,&Xu, Lu.(2017).HWM: a hybrid workload migration mechanism of metadata server cluster in data center.FRONTIERS OF COMPUTER SCIENCE,11(1),75-87. |
| MLA | Liu, Jian,et al."HWM: a hybrid workload migration mechanism of metadata server cluster in data center".FRONTIERS OF COMPUTER SCIENCE 11.1(2017):75-87. |
入库方式： OAI收割
来源：计算技术研究所
浏览0
下载0
收藏0
其他版本
除非特别说明，本系统中所有内容都受版权保护，并保留所有权利。