BAS-ADAM: An ADAM Based Approach to Improve the Performance of Beetle Antennae Search Optimizer
文献类型：期刊论文
| 作者 | Ameer Hamza Khan; Xinwei Cao; Shuai Li; Vasilios N. Katsikis; Liefa Liao |
| 刊名 | IEEE/CAA Journal of Automatica Sinica
 |
| 出版日期 | 2020 |
| 卷号 | 7期号:2页码:461-471 |
| 关键词 | Adaptive moment estimation (ADAM) Beetle antennae search (BAM) gradient estimation metaheuristic optimization nature-inspired algorithms neural network |
| ISSN号 | 2329-9266 |
| DOI | 10.1109/JAS.2020.1003048 |
| 英文摘要 | In this paper, we propose enhancements to Beetle Antennae search (BAS) algorithm, called BAS-ADAM, to smoothen the convergence behavior and avoid trapping in local-minima for a highly non-convex objective function. We achieve this by adaptively adjusting the step-size in each iteration using the adaptive moment estimation (ADAM) update rule. The proposed algorithm also increases the convergence rate in a narrow valley. A key feature of the ADAM update rule is the ability to adjust the step-size for each dimension separately instead of using the same step-size. Since ADAM is traditionally used with gradient-based optimization algorithms, therefore we first propose a gradient estimation model without the need to differentiate the objective function. Resultantly, it demonstrates excellent performance and fast convergence rate in searching for the optimum of non-convex functions. The efficiency of the proposed algorithm was tested on three different benchmark problems, including the training of a high-dimensional neural network. The performance is compared with particle swarm optimizer (PSO) and the original BAS algorithm. |
| 源URL | [http://ir.ia.ac.cn/handle/173211/42957]  |
| 专题 | 自动化研究所_学术期刊_IEEE/CAA Journal of Automatica Sinica |
| 推荐引用方式 GB/T 7714 | Ameer Hamza Khan,Xinwei Cao,Shuai Li,et al. BAS-ADAM: An ADAM Based Approach to Improve the Performance of Beetle Antennae Search Optimizer[J]. IEEE/CAA Journal of Automatica Sinica,2020,7(2):461-471. |
| APA | Ameer Hamza Khan,Xinwei Cao,Shuai Li,Vasilios N. Katsikis,&Liefa Liao.(2020).BAS-ADAM: An ADAM Based Approach to Improve the Performance of Beetle Antennae Search Optimizer.IEEE/CAA Journal of Automatica Sinica,7(2),461-471. |
| MLA | Ameer Hamza Khan,et al."BAS-ADAM: An ADAM Based Approach to Improve the Performance of Beetle Antennae Search Optimizer".IEEE/CAA Journal of Automatica Sinica 7.2(2020):461-471. |
入库方式： OAI收割
来源：自动化研究所
浏览0
下载0
收藏0
其他版本
除非特别说明，本系统中所有内容都受版权保护，并保留所有权利。