Low-cost high performance distributed data storage for multi-channel observations
文献类型：期刊论文
| 作者 | Liu YB(刘应波)1,2,3 ; Wang F(王锋)1,2,3; Deng, H1; Ji, KF1; Dai W(戴伟)1,2,3; Wei SL(卫守林)1,2,3; Liang, B1; Zhang, XL1
|
| 刊名 | NEW ASTRONOMY
 |
| 出版日期 | 2015-10 |
| 卷号 | 40页码:78-86 |
| 关键词 | Astronomical databases: miscellaneous Methods: massive solar data storage Techniques: high performance I/O |
| ISSN号 | 1384-1076 |
| 产权排序 | 第二完成单位 |
| 通讯作者 | Wang, F (reprint author), Kunming Univ Sci & Technol, Comp Technol Applicat Key Lab Yunnan Prov, Chenggong 650500, Kunming, Peoples R China. |
| 英文摘要 | The New Vacuum Solar Telescope (NVST) is a 1-m solar telescope that aims to observe the fine structures in both the photosphere and the chromosphere of the Sun. The observational data acquired simultaneously from one channel for the chromosphere and two channels for the photosphere bring great challenges to the data storage of NVST. The multi-channel instruments of NVST, including scientific cameras and multi-band spectrometers, generate at least 3 terabytes data per day and require high access performance while storing massive short-exposure images. It is worth studying and implementing a storage system for NVST which would balance the data availability, access performance and the cost of development. In this paper, we build a distributed data storage system (DDSS) for NVST and then deeply evaluate the availability of real-time data storage on a distributed computing environment. The experimental results show that two factors, i.e., the number of concurrent read/write and the file size, are critically important for improving the performance of data access on a distributed environment. Referring to these two factors, three strategies for storing FITS files are presented and implemented to ensure the access performance of the DDSS under conditions of multi-host write and read simultaneously. The real applications of the DDSS proves that the system is capable of meeting the requirements of NVST real-time high performance observational data storage. Our study on the DDSS is the first attempt for modern astronomical telescope systems to store real-time observational data on a low-cost distributed system. The research results and corresponding techniques of the DDSS provide a new option for designing real-time massive astronomical data storage system and will be a reference for future astronomical data storage. (C) 2015 Elsevier B.V. All rights reserved. |
| WOS标题词 | Science & Technology ; Physical Sciences |
| 学科主题 | Astronomy & Astrophysics |
| 类目[WOS] | Astronomy & Astrophysics |
| 研究领域[WOS] | Astronomy & Astrophysics |
| 收录类别 | SCI |
| 原文出处 | http://www.sciencedirect.com/science/article/pii/S1384107615000470 |
| 语种 | 英语 |
| WOS记录号 | WOS:000356552700009 |
| 源URL | [http://ir.ynao.ac.cn/handle/114a53/4257]  |
| 专题 | 云南天文台_其他 |
| 作者单位 | 1.Computer Technology Application Key Lab of Yunnan Province, Kunming University of Science and Technology, Chenggong, Kunming 650500, China 2.Yunnan Observatories, Chinese Academy of Sciences, Kunming 650011, China 3.University of Chinese Academy of Sciences, Beijing 100049, China |
| 推荐引用方式 GB/T 7714 | Liu YB,Wang F,Deng, H,et al. Low-cost high performance distributed data storage for multi-channel observations[J]. NEW ASTRONOMY,2015,40:78-86. |
| APA | Liu YB.,Wang F.,Deng, H.,Ji, KF.,Dai W.,...&Zhang, XL.(2015).Low-cost high performance distributed data storage for multi-channel observations.NEW ASTRONOMY,40,78-86. |
| MLA | Liu YB,et al."Low-cost high performance distributed data storage for multi-channel observations".NEW ASTRONOMY 40(2015):78-86. |
入库方式： OAI收割
来源：云南天文台
浏览0
下载0
收藏0
其他版本
除非特别说明，本系统中所有内容都受版权保护，并保留所有权利。