中国科学院机构知识库网格
Chinese Academy of Sciences Institutional Repositories Grid
Cascaded Write Amplification of LSM-tree-based Key-Value Stores underlying Solid-State Disks

文献类型:期刊论文

作者Sun, Hui1,2; Dai, Shangshang1; Huang, Jianzhong3
刊名MICROPROCESSORS AND MICROSYSTEMS
出版日期2020-10-01
卷号78页码:16
ISSN号0141-9331
关键词Log-structured merge tree Write amplification Solid state disks Key-value stores
DOI10.1016/j.micpro.2020.103217
英文摘要Log-structured merge tree (i.e., LSM-tree)-based key-value stores (i.e., KV stores) are widely used in big-data applications and provide high performance. NAND Flash-based Solid-state disks (i.e., SSDs) have become a popular storage device alternative to hard disk drives (i.e., HDDs) because of their high performance and low power consumption. LSM-tree KV stores with SSDs are deployed in large-scale storage systems, which aims to achieve high performance in the cloud. Write amplification in LSM-tree KV stores and NAND Flash memory in SSDs are defined as WA1 and WA2 in this paper. The former, which is attributed to compaction operations in LSM-tree-based KV stores, is a burden on I/O bandwidth between the host and the device. The latter, which results from out-place updates in NAND Flash memory, blocks user I/O requests between the host and NAND Flash memory, thereby degrading the SSD performance. Write amplification impairs the overall system performance. In this study, we explored the two-level cascaded write amplification in LSM-tree KV stores with SSDs. The cascaded write amplification is represented as WA. Our primary goal is to comprehensively study two-level cascaded write amplification on the host-side LSM-tree KV stores and the device-side SSDs. We quantitatively analyze the impact of two-level write amplification on overall performance. The cascaded write amplification is 16.44 (WA1 is 16.55; WA2 is 0.99) and 35.51 (WA1 is 16.6; WA2 is 2.14) for SSD-I and SSD-S with LevelDB's default setting under DB_bench. The larger cascaded write amplification of KV stores has a bad impact on SSD performance and lifetime. The throughput of SSD-S and SSD-I under an 80%-write workload is approximately 0.28x and 0.31x of that under a 100%-write workload. Therefore, it is important to design a novel approach to balance the cost of an SSD lifetime caused by cascaded write amplification and its high performance under the read-write-mixed workloads. We attempt to reveal details of cascaded write amplification and hope that this study is useful for developers of LSM-tree-based KV stores and SSD software stacks.
资助项目National Natural Science Foundation of China[61702004] ; National Natural Science Foundation of China[61572209] ; State Key Laboratory of Computer Architecture (ICT, CAS), China[CARCH201915]
WOS研究方向Computer Science ; Engineering
语种英语
出版者ELSEVIER
WOS记录号WOS:000579525100007
源URL[http://119.78.100.204/handle/2XEOYT63/15684]  
专题中国科学院计算技术研究所期刊论文_英文
通讯作者Huang, Jianzhong
作者单位1.Anhui Univ, Sch Comp Sci & Technol, Hefei, Peoples R China
2.Chinese Acad Sci, Inst Comp Technol, State Key Lab Comp Architecture, Beijing, Peoples R China
3.Huazhong Univ Sci & Technol, Wuhan Natl Lab Optoelect, Wuhan, Peoples R China
推荐引用方式
GB/T 7714
Sun, Hui,Dai, Shangshang,Huang, Jianzhong. Cascaded Write Amplification of LSM-tree-based Key-Value Stores underlying Solid-State Disks[J]. MICROPROCESSORS AND MICROSYSTEMS,2020,78:16.
APA Sun, Hui,Dai, Shangshang,&Huang, Jianzhong.(2020).Cascaded Write Amplification of LSM-tree-based Key-Value Stores underlying Solid-State Disks.MICROPROCESSORS AND MICROSYSTEMS,78,16.
MLA Sun, Hui,et al."Cascaded Write Amplification of LSM-tree-based Key-Value Stores underlying Solid-State Disks".MICROPROCESSORS AND MICROSYSTEMS 78(2020):16.

入库方式: OAI收割

来源:计算技术研究所

浏览0
下载0
收藏0
其他版本

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。