Real-Time Acoustic Holography With Physics-Based Deep Learning for Robotic Manipulation
文献类型:期刊论文
作者 | Zhong, Chengxi4; Li, Jiaqi4; Sun, Zhenhuan4; Li, Teng4; Guo, Yao3; Jeong, David C.2; Su, Hu1![]() ![]() |
刊名 | IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING
![]() |
出版日期 | 2023-07-17 |
页码 | 10 |
关键词 | Index Terms-Acoustic holography (AH) inverse kinematics phased array of transducers (PAT) robotic manipulation |
ISSN号 | 1545-5955 |
DOI | 10.1109/TASE.2023.3292885 |
通讯作者 | Su, Hu(hu.su@ia.ac.cn) ; Liu, Song(liusong@shanghaitech.edu.cn) |
英文摘要 | Acoustic holography (AH) is a promising technique for precise noncontact micro-nano robotic manipulation. It encodes a three-dimensional (3D) acoustic field acting as a virtual end-effector into a two-dimensional (2D) hologram, whereby the desired acoustic field reconstruction is made possible. Most traditional methods to implement AH, such as 3D printed holographic lens and phased array of transducers (PAT), have limitations of dynamic and dexterous manipulation. Furthermore, existing iterative optimization algorithms to calculate 2D holograms have inadequate accuracy and real-time performance. To address these issues, this paper proposes a physics-based deep learning method with a novel training framework for phase-only hologram (POH) calculation enabling further pushing forward the PAT-based AH for noncontact robotic manipulation. By implementing independent control of each channel on PAT referring real-time calculated POH by a well-trained network, the desired acoustic field can be reconstructed in real-time with high fidelity. The results both on a simulated dataset and a real dataset demonstrate that our method supports accurate and dynamic reconstruction of desired acoustic field with distinct morphologies, with an average reconstruction error of 0.085 and average POH computing time of 47 milliseconds on GPU. Indeed, this work shows the future potential of AH in the field of noninvasive medical therapy, exogenous material delivery, and miniaturized industrial assembly. Note to Practitioners-This paper addresses the challenge of noncontact micro-nano robotic manipulation by PAT-based AH, an intriguing technique in bioengineering, micro-assembly, and material characterization. However, existing approaches have limited precision and real-time performance. To overcome these limitations, this paper proposes a physics-based deep learning method with a novel training framework. Our method achieves excellent accuracy and real-time performance, enabling efficient reconstruction of various complicated acoustic field morphologies for precise and dynamic acoustic manipulation. Experimental results demonstrate its high manipulation flexibility due to the independent modulation of each channel of PAT and real-time precise control due to the ultrafast calculation of the proposed deep learning method, though the method has not yet been deployed into an acoustic manipulation system and tested in practice. Future research will focus on designing physical experiments for further evaluation. Overall, the proposed method provides a novel and promising basis for desired acoustic field generation. |
WOS关键词 | IMAGE |
资助项目 | Shanghai Pujiang Program[21PJ1410500] ; ShanghaiTech Startup Funding |
WOS研究方向 | Automation & Control Systems |
语种 | 英语 |
WOS记录号 | WOS:001035933400001 |
出版者 | IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC |
资助机构 | Shanghai Pujiang Program ; ShanghaiTech Startup Funding |
源URL | [http://ir.ia.ac.cn/handle/173211/53804] ![]() |
专题 | 多模态人工智能系统全国重点实验室 |
通讯作者 | Su, Hu; Liu, Song |
作者单位 | 1.Chinese Acad Sci, Inst Automat, Beijing 100190, Peoples R China 2.Santa Clara Univ, Dept Commun, Santa Clara, CA 95053 USA 3.Shanghai Jiao Tong Univ, Inst Med Robot, Shanghai 200240, Peoples R China 4.ShanghaiTech Univ, Sch Informat Sci & Technol, Shanghai 201210, Peoples R China 5.Shanghai Engn Res Ctr Intelligent Vis & Imaging, Shanghai 201210, Peoples R China |
推荐引用方式 GB/T 7714 | Zhong, Chengxi,Li, Jiaqi,Sun, Zhenhuan,et al. Real-Time Acoustic Holography With Physics-Based Deep Learning for Robotic Manipulation[J]. IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING,2023:10. |
APA | Zhong, Chengxi.,Li, Jiaqi.,Sun, Zhenhuan.,Li, Teng.,Guo, Yao.,...&Liu, Song.(2023).Real-Time Acoustic Holography With Physics-Based Deep Learning for Robotic Manipulation.IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING,10. |
MLA | Zhong, Chengxi,et al."Real-Time Acoustic Holography With Physics-Based Deep Learning for Robotic Manipulation".IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING (2023):10. |
入库方式: OAI收割
来源:自动化研究所
浏览0
下载0
收藏0
其他版本
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。