Express Wavenet: A lower parameter optical neural network with random shift wavelet pattern
文献类型:期刊论文
作者 | Y. Chen; N. Feng; B. Hong; M. S. Tong; G. P. Wang and Z. Liang |
刊名 | Optics Communications
![]() |
出版日期 | 2021 |
卷号 | 485 |
ISSN号 | 304018 |
DOI | 10.1016/j.optcom.2020.126709 |
英文摘要 | Compared with other optical diffractive neural networks, the express wavenet (ExWave) is an improved and efficient network which adopts much fewer parameters. For advantages of the ExWave, firstly, the wavelet-like pattern is used to modulate the phase of optical waves; secondly, the number of parameters can be reduced from O(n2) to O(n), for the input image with n2 pixels; thirdly, the accuracy can be still high with only 1% of total parameters of the famous D2 NN. Besides, in the modified national institute of standards and technology (MNIST) dataset, 93.5% accuracy can be achieved with only 2457 parameters, nevertheless, 250880 parameters are required to meet a similar accuracy for the standard optical network. Moreover, the random shift wavelets exhibit characteristics of optical network vividly, especially for the vanishing gradient phenomenon in the training process. We present the modified expressway structure for solving this problem. Afterward, simulation have been carried out to validate effects of both random shift wavelet and expressway structure. Finally, it can be shown that the optical diffractive network in this work utilizes much fewer parameters than other neural networks. The detailed source code can be available in the following link: https://github.com/closest-git/ONNet. 2020 Elsevier B.V. |
URL标识 | 查看原文 |
源URL | [http://ir.ciomp.ac.cn/handle/181722/65236] ![]() |
专题 | 中国科学院长春光学精密机械与物理研究所 |
推荐引用方式 GB/T 7714 | Y. Chen,N. Feng,B. Hong,et al. Express Wavenet: A lower parameter optical neural network with random shift wavelet pattern[J]. Optics Communications,2021,485. |
APA | Y. Chen,N. Feng,B. Hong,M. S. Tong,&G. P. Wang and Z. Liang.(2021).Express Wavenet: A lower parameter optical neural network with random shift wavelet pattern.Optics Communications,485. |
MLA | Y. Chen,et al."Express Wavenet: A lower parameter optical neural network with random shift wavelet pattern".Optics Communications 485(2021). |
入库方式: OAI收割
浏览0
下载0
收藏0
其他版本
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。