Parallel Processing of Dynamic Continuous Queries over Streaming Data Flows
文献类型:期刊论文
作者 | Deng, Ze1; Wu, Xiaoming1; Wang, Lizhen1; Chen, Xiaodao1; Ranjan, Rajiv1; Zomaya, Albert1; Chen, Dan1 |
刊名 | IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS
![]() |
出版日期 | 2015 |
卷号 | 26期号:3页码:381-397 |
关键词 | Streaming data cell-tree query indexing structure KDB-Tree big data computing data-intensive computing GPGPU |
通讯作者 | Deng, Z (reprint author), China Univ Geosci, Sch Comp Sci, Wuhan 430074, Peoples R China. |
英文摘要 | More and more real-time applications need to handle dynamic continuous queries over streaming data of high density. Conventional data and query indexing approaches generally do not apply for excessive costs in either maintenance or space. Aiming at these problems, this study first proposes a new indexing structure by fusing an adaptive cell and KDB-tree, namely CKDB-tree. A cell-tree indexing approach has been developed on the basis of the CKDB-tree that supports dynamic continuous queries. The approach significantly reduces the space costs and scales well with the increasing data size. Towards providing a scalable solution to filtering massive steaming data, this study has explored the feasibility to utilize the contemporary general-purpose computing on the graphics processing unit (GPGPU). The CKDB-tree-based approach has been extended to operate on both the CPU (host) and the GPU (device). The GPGPU-aided approach performs query indexing on the host while perform streaming data filtering on the device in a massively parallel manner. The two heterogeneous tasks execute in parallel and the latency of streaming data transfer between the host and the device is hidden. The experimental results indicate that (1) CKDB-tree can reduce the space cost comparing to the cell-based indexing structure by 60 percent on average, (2) the approach upon the CKDB-tree outperforms the traditional counterparts upon the KDB-tree by 66, 75 and 79 percent in average for uniform, skewed and hyper-skewed data in terms of update costs, and (3) the GPGPU-aided approach greatly improves the approach upon the CKDB-tree with the support of only a single Kepler GPU, and it provides real-time filtering of streaming data with 2.5M data tuples per second. The massively parallel computing technology exhibits great potentials in streaming data monitoring. |
研究领域[WOS] | Computer Science, Theory & Methods ; Engineering, Electrical & Electronic |
收录类别 | SCI ; EI |
语种 | 英语 |
WOS记录号 | WOS:000349769500019 |
源URL | [http://ir.ceode.ac.cn/handle/183411/38473] ![]() |
专题 | 遥感与数字地球研究所_SCI/EI期刊论文_期刊论文 |
作者单位 | 1.[Deng, Ze 2.Wu, Xiaoming 3.Wang, Lizhen 4.Chen, Xiaodao 5.Chen, Dan] China Univ Geosci, Sch Comp Sci, Wuhan 430074, Peoples R China 6.[Wang, Lizhen] Chinese Acad Sci, Inst Remote Sensing & Digital Earth, Beijing, Peoples R China 7.[Ranjan, Rajiv] CSIRO, ICT Ctr, Computat Informat Div, Sydney, NSW, Australia 8.[Zomaya, Albert] Univ Sydney, Sch Informat Technol, Sydney, NSW 2006, Australia 9.[Chen, Dan] Collaborat & Innovat Ctr Educ Technol, Beijing, Peoples R China |
推荐引用方式 GB/T 7714 | Deng, Ze,Wu, Xiaoming,Wang, Lizhen,et al. Parallel Processing of Dynamic Continuous Queries over Streaming Data Flows[J]. IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS,2015,26(3):381-397. |
APA | Deng, Ze.,Wu, Xiaoming.,Wang, Lizhen.,Chen, Xiaodao.,Ranjan, Rajiv.,...&Chen, Dan.(2015).Parallel Processing of Dynamic Continuous Queries over Streaming Data Flows.IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS,26(3),381-397. |
MLA | Deng, Ze,et al."Parallel Processing of Dynamic Continuous Queries over Streaming Data Flows".IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS 26.3(2015):381-397. |
入库方式: OAI收割
来源:遥感与数字地球研究所
浏览0
下载0
收藏0
其他版本
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。