Massive Data Management and Sharing Module for Connectome Reconstruction
文献类型：期刊论文
| 作者 | Yuan, Jingbin1 ; Zhang, Jing1; Shen, Lijun2; Zhang, Dandan2; Yu, Wenhuan2; Han, Hua3,4,5
|
| 刊名 | BRAIN SCIENCES
 |
| 出版日期 | 2020-05-01 |
| 卷号 | 10期号:5页码:15 |
| 关键词 | connectome massive data management distributed storage and retrieval electron microscope image segmentation result image cache |
| DOI | 10.3390/brainsci10050314 |
| 通讯作者 | Shen, Lijun(lijun.shen@ia.ac.cn) ; Han, Hua(hua.han@ia.ac.cn) |
| 英文摘要 | Recently, with the rapid development of electron microscopy (EM) technology and the increasing demand of neuron circuit reconstruction, the scale of reconstruction data grows significantly. This brings many challenges, one of which is how to effectively manage large-scale data so that researchers can mine valuable information. For this purpose, we developed a data management module equipped with two parts, a storage and retrieval module on the server-side and an image cache module on the client-side. On the server-side, Hadoop and HBase are introduced to resolve massive data storage and retrieval. The pyramid model is adopted to store electron microscope images, which represent multiresolution data of the image. A block storage method is proposed to store volume segmentation results. We design a spatial location-based retrieval method for fast obtaining images and segments by layers rapidly, which achieves a constant time complexity. On the client-side, a three-level image cache module is designed to reduce latency when acquiring data. Through theoretical analysis and practical tests, our tool shows excellent real-time performance when handling large-scale data. Additionally, the server-side can be used as a backend of other similar software or a public database to manage shared datasets, showing strong scalability. |
| WOS关键词 | SCANNING-ELECTRON-MICROSCOPY ; HIGH-RESOLUTION ; CONNECTIVITY ; ANNOTATION ; ANATOMY |
| 资助项目 | National Science Foundation of China[61673381] ; National Science Foundation of China[61201050] ; National Science Foundation of China[61306070] ; National Science Foundation of China[61701497] ; National Science Foundation of China[11771130] ; National Science Foundation of China[61871177] ; Special Program of Beijing Municipal Science and Technology Commission[Z181100000118002] ; Strategic Priority Research Program of the Chinese Academy of Science[XDB32030200] ; Scientific Research Instrument and Equipment Development Project of the Chinese Academy of Sciences[YZ201671] |
| WOS研究方向 | Neurosciences & Neurology |
| 语种 | 英语 |
| WOS记录号 | WOS:000541036100021 |
| 出版者 | MDPI |
| 资助机构 | National Science Foundation of China ; Special Program of Beijing Municipal Science and Technology Commission ; Strategic Priority Research Program of the Chinese Academy of Science ; Scientific Research Instrument and Equipment Development Project of the Chinese Academy of Sciences |
| 源URL | [http://ir.ia.ac.cn/handle/173211/39915]  |
| 专题 | 类脑智能研究中心_微观重建与智能分析 |
| 通讯作者 | Shen, Lijun; Han, Hua |
| 作者单位 | 1.Harbin Univ Sci & Technol, Sch Automat, Harbin 150080, Peoples R China 2.Chinese Acad Sci, Res Ctr Brain Inspired Intelligence, Inst Automat, Beijing 100190, Peoples R China 3.Chinese Acad Sci, Inst Automat, Natl Lab Pattern Recognit, Beijing 100190, Peoples R China 4.Chinese Acad Sci, Ctr Excellence Brain Sci & Intelligence Technol, Shanghai 200031, Peoples R China 5.Univ Chinese Acad Sci, Sch Future Technol, Beijing 100049, Peoples R China |
| 推荐引用方式 GB/T 7714 | Yuan, Jingbin,Zhang, Jing,Shen, Lijun,et al. Massive Data Management and Sharing Module for Connectome Reconstruction[J]. BRAIN SCIENCES,2020,10(5):15. |
| APA | Yuan, Jingbin,Zhang, Jing,Shen, Lijun,Zhang, Dandan,Yu, Wenhuan,&Han, Hua.(2020).Massive Data Management and Sharing Module for Connectome Reconstruction.BRAIN SCIENCES,10(5),15. |
| MLA | Yuan, Jingbin,et al."Massive Data Management and Sharing Module for Connectome Reconstruction".BRAIN SCIENCES 10.5(2020):15. |
入库方式： OAI收割
来源：自动化研究所
浏览0
下载0
收藏0
其他版本
除非特别说明，本系统中所有内容都受版权保护，并保留所有权利。