中国科学院机构知识库网格
Chinese Academy of Sciences Institutional Repositories Grid
首页 机构 成果 学者
  
  1. CAS IR Grid
  2. 计算技术研究所
  3. 中国科学院计算技术研究所
  4. 中国科学院计算技术研究所期刊论文
  5. 英文
dCompaction: Delayed Compaction for the LSM-Tree

文献类型：期刊论文

作者Pan, Fengfeng1,2; Yue, Yinliang3; Xiong, Jin1
刊名INTERNATIONAL JOURNAL OF PARALLEL PROGRAMMING
出版日期2017-12-01
卷号45期号:6页码:1310-1325
关键词Key-value store LSM-tree Write amplification Delayed compaction Virtual compaction Real compaction
ISSN号0885-7458
DOI10.1007/s10766-016-0472-z
英文摘要Key-value (KV) stores have become a backbone of large-scale applications in today's data centers. Write-optimized data structures like the Log-Structured Merge-tree (LSM-tree) and their variants are widely used in KV storage systems like BigTable and RocksDB. Conventional LSM-tree organizes KV items into multiple, successively larger components, and uses compaction to push KV items from one smaller component to another adjacent larger component until the KV items reach the largest component. Unfortunately, current compaction scheme incurs significant write amplification due to repeated KV item reads and writes, and then results in poor throughput. We propose a new compaction scheme, delayed compaction (dCompaction), that decreases write amplification. dCompaction postpones some compactions and gather them into the following compaction. In this way, it avoids KV item reads and writes during compaction, and consequently improves the throughput of LSM-tree based KV stores. We implement dCompaction on RocksDB, and conduct extensive experiments. Validation using YCSB framework shows that compared with RocksDB dCompaction has about 30% write performance improvements and also comparable read performance.
资助项目MOST's 13th FYP project of China[2016YFB1000202] ; National Science Foundation of China[61303056] ; National Science Foundation of China[61379042] ; Youth Innovation Promotion Association, CAS[2016146]
WOS研究方向Computer Science
语种英语
WOS记录号WOS:000411558500005
出版者SPRINGER/PLENUM PUBLISHERS
源URL[http://119.78.100.204/handle/2XEOYT63/6810]  
专题中国科学院计算技术研究所期刊论文_英文
通讯作者Pan, Fengfeng
作者单位1.Chinese Acad Sci, Inst Comp Technol, State Key Lab Comp Architecture, Beijing, Peoples R China
2.Univ Chinese Acad Sci, Beijing, Peoples R China
3.Chinese Acad Sci, Inst Informat Engn, Beijing, Peoples R China
推荐引用方式
GB/T 7714		 Pan, Fengfeng,Yue, Yinliang,Xiong, Jin. dCompaction: Delayed Compaction for the LSM-Tree[J]. INTERNATIONAL JOURNAL OF PARALLEL PROGRAMMING,2017,45(6):1310-1325.
APA Pan, Fengfeng,Yue, Yinliang,&Xiong, Jin.(2017).dCompaction: Delayed Compaction for the LSM-Tree.INTERNATIONAL JOURNAL OF PARALLEL PROGRAMMING,45(6),1310-1325.
MLA Pan, Fengfeng,et al."dCompaction: Delayed Compaction for the LSM-Tree".INTERNATIONAL JOURNAL OF PARALLEL PROGRAMMING 45.6(2017):1310-1325.

入库方式： OAI收割

来源：计算技术研究所

浏览0
下载0
收藏0
其他版本

除非特别说明，本系统中所有内容都受版权保护，并保留所有权利。