Multimodal fusion-based high-fidelity compressed ultrafast photography
文献类型:期刊论文
作者 | He, Yu5; Yao, Yunhua5; He, Yilin5; Jin, Chengzhi5; Huang, Zhengqi5; Guo, Mengdi5; Yao, Jiali5; Qi, Dalong5; Shen, Yuecheng5; Deng, Lianzhong5 |
刊名 | Optics and Lasers in Engineering
![]() |
出版日期 | 2024-10 |
卷号 | 181 |
关键词 | Ultrafast imaging Compressed ultrafast photography Image reconstruction |
ISSN号 | 01438166 |
DOI | 10.1016/j.optlaseng.2024.108363 |
产权排序 | 3 |
英文摘要 | Featuring high frame rate and large sequence depth in a single shot, compressed ultrafast photography (CUP) has emerged as an outstanding tool for observing ultrafast phenomena, especially those unrepeatable or irreversible ones. However, the lower image quality in CUP due to high data compressive ratio has always been a tough issue, hampering its further applications in capturing the transient scenes with fine structural information. To overcome this disadvantage in CUP, here we report a multimodal fusion-based compressed ultrafast photography to achieve high-fidelity ultrafast imaging, termed MF-CUP. MF-CUP simultaneously records the dynamic scenes with three different imaging models, involving CUP, transient imaging and spatiotemporal integration imaging. Attributed to the joint acquisition of the dynamic scenes from different imaging models and the multimodal fusion image reconstruction algorithm enabled by untrained neural network, MF-CUP acquires the higher fidelity in both spatial and temporal domains compared with traditional CUP. Both the simulation and experimental results demonstrate that MF-CUP can effectively enhance the accuracy and quality of reconstructed images. Given this high-fidelity imaging ability of MF-CUP, it will provide a powerful tool for the detection of ultrafast dynamics with fine details. © 2024 Elsevier Ltd |
语种 | 英语 |
出版者 | Elsevier Ltd |
源URL | [http://ir.opt.ac.cn/handle/181661/97533] ![]() |
专题 | 条纹相机工程中心 |
通讯作者 | Yao, Yunhua |
作者单位 | 1.Collaborative Innovation Center of Extreme Optics, Shanxi University, Taiyuan; 030006, China 2.Joint Research Center of Light Manipulation Science and Photonic Integrated Chip of East China Normal University and Shandong Normal University, East China Normal University, Shanghai, 200241, China; 3.Xi'an Institute of Optics and Precision Mechanics, Chinese Academy of Sciences, Xi'an; 710119, China; 4.School of Mathematical Sciences, University of Electronic Science and Technology of China, Chengdu; 611731, China; 5.State Key Laboratory of Precision Spectroscopy, School of Physics and Electronic Science, East China Normal University, Shanghai, 200241, China; |
推荐引用方式 GB/T 7714 | He, Yu,Yao, Yunhua,He, Yilin,et al. Multimodal fusion-based high-fidelity compressed ultrafast photography[J]. Optics and Lasers in Engineering,2024,181. |
APA | He, Yu.,Yao, Yunhua.,He, Yilin.,Jin, Chengzhi.,Huang, Zhengqi.,...&Zhang, Shian.(2024).Multimodal fusion-based high-fidelity compressed ultrafast photography.Optics and Lasers in Engineering,181. |
MLA | He, Yu,et al."Multimodal fusion-based high-fidelity compressed ultrafast photography".Optics and Lasers in Engineering 181(2024). |
入库方式: OAI收割
来源:西安光学精密机械研究所
其他版本
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。