A tile-based scalable raster data management system based on HDFS
文献类型：会议论文
| 作者 | Zhang,Guangqing(张广庆) ; Xie,Chuanjie ; Shi,Lei ; Du,Yunyan |
| 出版日期 | 2012 |
| 会议名称 | 2012 20th International Conference on Geoinformatics, Geoinformatics 2012 |
| 会议日期 | June 15, 2012 - June 17, 2012 |
| 会议地点 | Hong Kong, China |
| 关键词 | Data structures Information management Metadata |
| 通讯作者 | Xie, C |
| 英文摘要 | Hadoop has become a worldwide popular open source platform for large data analysis in commercial application and Hadoop distributed file system (HDFS) is the core part of it. However, HDFS cannot be used directly for managing raster data, for the geographic location information is involved. In this paper, we describe the implementation of a tile-based scalable raster data management system based on HDFS. While reserving the basic architecture of HDFS, we reorganize the data structure in block, add some additional metadata, design an index data structure in block, keep an overlapping region between adjacent blocks, and offer a compression option for users. Besides, we provide functions for reading the raster data from HDFS in tile stream. These optimizations match the feature of raster data to the architecture of HDFS. MapReduce Applications can be built on the raster data management system. |
| 收录类别 | EI |
| 会议录 | Proceedings - 2012 20th International Conference on Geoinformatics, Geoinformatics 2012
 |
| 会议录出版者 | IEEE Computer Society |
| 会议录出版地 | 2001 L Street N.W., Suite 700, Washington, DC 20036-4928, United States |
| 语种 | 英语 |
| ISBN号 | 9781467311045 |
| 源URL | [http://ir.igsnrr.ac.cn/handle/311030/27877]  |
| 专题 | 地理科学与资源研究所_研究生部 |
| 推荐引用方式 GB/T 7714 | Zhang,Guangqing,Xie,Chuanjie,Shi,Lei,et al. A tile-based scalable raster data management system based on HDFS[C]. 见:2012 20th International Conference on Geoinformatics, Geoinformatics 2012. Hong Kong, China. June 15, 2012 - June 17, 2012. |
入库方式： OAI收割
来源：地理科学与资源研究所
浏览0
下载0
收藏0
其他版本
除非特别说明，本系统中所有内容都受版权保护，并保留所有权利。