Joint Operator Scaling and Placement for Distributed Stream Processing Applications in Edge Computing
文献类型：会议论文
| 作者 | Peng, Qinglan2; Xia, Yunni2; Wang, Yan3; Wu, Chunrong2; Luo, Xin1 ; Lee, Jia2
|
| 出版日期 | 2019 |
| 会议日期 | October 28, 2019 - October 31, 2019 |
| 会议地点 | Toulouse, France |
| DOI | 10.1007/978-3-030-33702-5_36 |
| 页码 | 461-476 |
| 英文摘要 | Distributed Stream Processing (DSP) systems are well acknowledged to be potent in processing huge volume of real-time stream data with low latency and high throughput. Recently, the edge computing paradigm shows great potentials in supporting and boosting the DSP applications, especially the time-critical and latency-sensitive ones, over the Internet of Things (IoT) or mobile devices by means of offloading the computation from remote cloud to edge servers for further reduced communication latencies. Nevertheless, various challenges, especially the joint operator scaling and placement, are yet to be properly explored and addressed. Traditional efforts in this direction usually assume that the data-flow graph of a DSP application is pre-given and static. The resulting models and methods can thus be ineffective and show bad user-perceived quality-of-service (QoS) when dealing with real-world scenarios with reconfigurable data-flow graphs and scalable operator placement. In contrast, in this paper, we consider that the data-flow graphs are configurable and hence propose the joint operator scaling and placement problem. To address this problem, we first build a queuing-network-based QoS estimation model, then formulate the problem into an integer-programming one, and finally propose a two-stage approach for finding the near-optimal solution. Experiments based on real-world DSP test cases show that our method achieves higher cost effectiveness than traditional ones while meeting the user-defined QoS constraints. © Springer Nature Switzerland AG 2019. |
| 会议录 | 17th International Conference on Service-Oriented Computing, ICSOC 2019
 |
| 语种 | 英语 |
| 电子版国际标准刊号 | 16113349 |
| ISSN号 | 03029743 |
| 源URL | [http://119.78.100.138/handle/2HOD01W0/9799]  |
| 专题 | 中国科学院重庆绿色智能技术研究院 |
| 作者单位 | 1.Chinese Academy of Sciences, Chongqing Institute of Green and Intelligent Technology, Chongqing, China 2.Software Theory and Technology Chongqing Key Lab, Chongqing University, Chongqing, China; 3.Department of Computing, Macquarie University, Sydney; NSW; 2109, Australia; |
| 推荐引用方式 GB/T 7714 | Peng, Qinglan,Xia, Yunni,Wang, Yan,et al. Joint Operator Scaling and Placement for Distributed Stream Processing Applications in Edge Computing[C]. 见:. Toulouse, France. October 28, 2019 - October 31, 2019. |
入库方式： OAI收割
来源：重庆绿色智能技术研究院
浏览0
下载0
收藏0
其他版本
除非特别说明，本系统中所有内容都受版权保护，并保留所有权利。