LDFS: A Low Latency In-Line Data Deduplication File System
文献类型:期刊论文
作者 | Zhou, Yongtao2; Deng, Yuhui1,2; Yang, Laurence T.3; Yang, Ru2; Si, Lei2 |
刊名 | IEEE ACCESS
![]() |
出版日期 | 2018 |
卷号 | 6页码:15743-15753 |
关键词 | Massive data inline data deduplication file system low latency disk bottleneck |
ISSN号 | 2169-3536 |
DOI | 10.1109/ACCESS.2018.2800763 |
英文摘要 | Due to the rapid proliferation of sensors and intelligent devices, the cyber-physical-social computing and networking (CPSCN) is emerging as a new computing paradigm. Massive data have been generated in the CPSCN environment. The traditional data deduplication is not able to handle the CPSCN environment due to the involved long latency. This paper presents a low latency in-line data deduplication file system (LDFS). The LDFS decouples the unique data block and fingerprint index by writing the address of data blocks to the corresponding file recipe and fingerprint index, thus avoiding accessing fingerprint index on the path of the read operation. For every unique data block, the LDFS assigns a globally unique ID, and thus, the LDFS only requires one disk access to obtain the corresponding data block reference count using the global ID. In order to guarantee the write performance, the LDFS employs finer granularity lock to optimize the block flushing strategy of write buffer. Experimental results demonstrate that the LDFS significantly enhances the read and write performance on the critical path in contrast to the traditional deduplication file system LessFS. Meanwhile, the LDFS achieves almost the same deduplication ratio (40.8) as that of LessFS. |
资助项目 | National Natural Science Foundation of China[61572232] ; Science and Technology Planning Project of Guangzhou[201604016100] ; Open Research Fund of Key Laboratory of Computer System and Architecture, Institute of Computing Technology, Chinese Academy of Sciences[CARCH201401] ; Open Research Fund of Key Laboratory of Computer System and Architecture, Institute of Computing Technology, Chinese Academy of Sciences[CARCH201705] |
WOS研究方向 | Computer Science ; Engineering ; Telecommunications |
语种 | 英语 |
WOS记录号 | WOS:000429978800001 |
出版者 | IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC |
源URL | [http://119.78.100.204/handle/2XEOYT63/5770] ![]() |
专题 | 中国科学院计算技术研究所期刊论文_英文 |
通讯作者 | Deng, Yuhui |
作者单位 | 1.Chinese Acad Sci, Inst Comp Technol, State Key Lab Comp Architecture, Beijing 100080, Peoples R China 2.Jinan Univ, Dept Comp Sci, Guangzhou 510632, Guangdong, Peoples R China 3.St Francis Xavier Univ, Dept Comp Sci, Antigonish, NS B2G 2W5, Canada |
推荐引用方式 GB/T 7714 | Zhou, Yongtao,Deng, Yuhui,Yang, Laurence T.,et al. LDFS: A Low Latency In-Line Data Deduplication File System[J]. IEEE ACCESS,2018,6:15743-15753. |
APA | Zhou, Yongtao,Deng, Yuhui,Yang, Laurence T.,Yang, Ru,&Si, Lei.(2018).LDFS: A Low Latency In-Line Data Deduplication File System.IEEE ACCESS,6,15743-15753. |
MLA | Zhou, Yongtao,et al."LDFS: A Low Latency In-Line Data Deduplication File System".IEEE ACCESS 6(2018):15743-15753. |
入库方式: OAI收割
来源:计算技术研究所
浏览0
下载0
收藏0
其他版本
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。