Fast matching of astronomical data within data warehouse architecture
文献类型:期刊论文
作者 | Zhang, Hailong1![]() ![]() ![]() |
刊名 | ICIC Express Letters
![]() |
出版日期 | 2014-10 |
卷号 | 8期号:10页码:2805-2811 |
通讯作者邮箱 | zhanghailong@xao.ac.cn |
关键词 | Information management Astronomy Data integration Data warehouses Digital storage Metadata Parallel architectures Telescopes |
ISSN号 | 1881-803X |
通讯作者 | Hailong Zhang |
英文摘要 | The data volume in astronomical digital sky surveys has reached hundreds of PB per year. How to efficiently manage the massive astronomical data in explosive growth, how to achieve the integration on multi-wavelength observation data, and how to rapidly release the huge amounts of data generated by the larger telescopes are urgent problems needing to be addressed. The main purpose of this paper is to put forward an astronomical data warehouse architecture design to manage and publish massive astronomical data. In the proposed architecture data servers deal with the raw data obtained from telescopes based on a predefined integration strategy, and save the standardized metadata structure and information. We build a multi-level data storage model, to extract the different levels of data sets from the raw data. This multi-level data asset is formed by constructing an object-based database and data warehouse management system, where all data are centralized in a reliable storage. Catalogues with huge number of objects have not yet had an efficient cross matching algorithm to achieve data integration from different band observations. With the implementation of this data warehouse architecture, we were able to adopt a parallel computing model to evaluate the matching method of massive astronomical catalogue data. By improving the speed of matching, this method could potentially pave a way for the development of large-scale astronomical data of future larger telescopes and gain experience. 2014 ICIC International. |
收录类别 | EI |
语种 | 英语 |
源URL | [http://ir.xao.ac.cn/handle/45760611-7/1028] ![]() |
专题 | 新疆天文台_计算机技术室 新疆天文台_射电天文研究室 新疆天文台_其它 科技计划处 |
作者单位 | 1.Xinjiang Astronomical Observatory, Chinese Academy of Sciences, No. 150, Science 1-Street, Urumqi 830011, China 2.University of Western Australia, Stirling Highway, WA 6009, Australia |
推荐引用方式 GB/T 7714 | Zhang, Hailong,Wang, Na,Chen, Wu,et al. Fast matching of astronomical data within data warehouse architecture[J]. ICIC Express Letters,2014,8(10):2805-2811. |
APA | Zhang, Hailong,Wang, Na,Chen, Wu,&Nie, Jun.(2014).Fast matching of astronomical data within data warehouse architecture.ICIC Express Letters,8(10),2805-2811. |
MLA | Zhang, Hailong,et al."Fast matching of astronomical data within data warehouse architecture".ICIC Express Letters 8.10(2014):2805-2811. |
入库方式: OAI收割
来源:新疆天文台
浏览0
下载0
收藏0
其他版本
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。