Improved Hadoop-based cloud for complex model simulation optimization: Calibration of SWAT as an example
文献类型：期刊论文
| ; | |
| 作者 | Ma, Jinfeng ; Rao, Kaifeng; Li, Ruonan; Yang, Yanzheng; Li, Weifeng; Zheng, Hua
|
| 刊名 | ENVIRONMENTAL MODELLING & SOFTWARE
 |
| 出版日期 | 2022-03 |
| 卷号 | 149期号:0页码:105330 |
| ISSN号 | 1364-8152 |
| 关键词 | MULTIOBJECTIVE EVOLUTIONARY ALGORITHM NONPOINT-SOURCE POLLUTION AUTOMATIC CALIBRATION UNCERTAINTY ANALYSIS WATER-QUALITY MANAGEMENT-PRACTICES HYDROLOGIC-MODELS MULTIPLE SOFTWARE INPUT |
| 英文摘要 | A simulation optimization framework requires a substantial number of model simulations, which are computationally intensive and may be impractical when the model simulations are extremely time-consuming. This paper presents an improved Hadoop-based cloud framework to alleviate the computational burden of optimization. The framework parallelizes conventional sequential-model-based optimization techniques by concurrently orchestrating multiple model computations within Hadoop MapReduce. It guarantees the reliability of simulation optimization tasks by handling node failures without affecting the ongoing simulation. A case study, using Bayesian optimization to calibrate a SWAT model, achieved a speedup of nearly 55-58 when using 100 cores, demonstrating the efficiency of parallelizing the Bayesian optimization algorithm on the Hadoop-based cloud. Experiments in which computing nodes were dynamically increased or decreased demonstrated that the framework can automatically rebalance the workload across the remaining nodes. The framework is readily adaptable to other complex model applications that perform sequential-model-based optimizations or large-scale simulations. |
| 源URL | [https://ir.rcees.ac.cn/handle/311016/47284]  |
| 专题 | 生态环境研究中心_城市与区域生态国家重点实验室 |
| 通讯作者 | Zheng, Hua |
| 作者单位 | 1.Chinese Acad Sci, State Key Joint Lab Environm Simulat & Pollut Con, Res Ctr Ecoenvironm Sci, Beijing 100085, Peoples R China 2.Chinese Acad Sci, State Key Lab Urban & Reg Ecol, Res Ctr Ecoenvironm Sci, Shuangqing Rd 18, Beijing 100085, Peoples R China 3.Univ Chinese Acad Sci, Beijing 100049, Peoples R China |
| 推荐引用方式 GB/T 7714 | Ma, Jinfeng,Rao, Kaifeng,Li, Ruonan,et al. Improved Hadoop-based cloud for complex model simulation optimization: Calibration of SWAT as an example, Improved Hadoop-based cloud for complex model simulation optimization_ Calibration of SWAT as an example.pdf[J]. ENVIRONMENTAL MODELLING & SOFTWARE,2022,149(0):105330. |
| APA | Ma, Jinfeng,Rao, Kaifeng,Li, Ruonan,Yang, Yanzheng,Li, Weifeng,&Zheng, Hua.(2022).Improved Hadoop-based cloud for complex model simulation optimization: Calibration of SWAT as an example.ENVIRONMENTAL MODELLING & SOFTWARE,149(0),105330. |
| MLA | Ma, Jinfeng,et al."Improved Hadoop-based cloud for complex model simulation optimization: Calibration of SWAT as an example".ENVIRONMENTAL MODELLING & SOFTWARE 149.0(2022):105330. |
入库方式： OAI收割
来源：生态环境研究中心
浏览0
下载0
收藏0
其他版本
除非特别说明，本系统中所有内容都受版权保护，并保留所有权利。