中国科学院机构知识库网格
Chinese Academy of Sciences Institutional Repositories Grid
首页 机构 成果 学者
  
  1. CAS IR Grid
  2. 计算技术研究所
  3. 中国科学院计算技术研究所
  4. 中国科学院计算技术研究所期刊论文
  5. 英文
AKGF: Automatic Kernel Generation for DNN on CPU-FPGA

文献类型：期刊论文

作者Dong, Dong1; Jiang, Hongxu1; Diao, Boyu2
刊名COMPUTER JOURNAL
出版日期2023-08-11
页码9
关键词DNN accelerated compilers polyhedral model heterogeneous computing CPU-FPGA
ISSN号0010-4620
DOI10.1093/comjnl/bxad086
英文摘要While tensor accelerated compilers have proven effective in deploying deep neural networks (DNN) on general-purpose hardware, optimizing for FPGA remains challenging due to the complex DNN architectures and the heterogeneous, semi-open compute units. This paper introduces the Automatic Kernel Generation for DNN on CPU-FPGA (AKGF) framework for efficient deployment of DNN on heterogeneous CPU-FPGA platforms. AKGF generates an intermediate representation (IR) of the DNN using TVM's Halide IR, annotates the operators of model layers in the IR to compute them on the corresponding hardware cores, and further optimizes the operator code for CPU and FPGA using ARM's function library and the polyhedral model to enhance model inference speed and power consumption. The experimental tests conducted on a CPU-FPGA board validate the effectiveness of AKGF, demonstrating significant acceleration ratios (up to 6.7x) compared to state-of-the-art accelerators while achieving a 2x power optimization. AKGF effectively leverages the computational capabilities of both CPU and FPGA for high-performance deployment of DNN on CPU-FPGA platforms.
资助项目National Key Research and Development Program of China[2021ZD0110202]
WOS研究方向Computer Science
语种英语
WOS记录号WOS:001051231100001
出版者OXFORD UNIV PRESS
源URL[http://119.78.100.204/handle/2XEOYT63/21377]  
专题中国科学院计算技术研究所期刊论文_英文
通讯作者Dong, Dong; Jiang, Hongxu; Diao, Boyu
作者单位1.Beihang Univ, Beijing Key Lab Digital Media, State Key Lab Virtual Real Technol & Syst, Beijing 100191, Peoples R China
2.Chinese Acad Sci, Inst Comp Technol, Beijing 100086, Peoples R China
推荐引用方式
GB/T 7714		 Dong, Dong,Jiang, Hongxu,Diao, Boyu. AKGF: Automatic Kernel Generation for DNN on CPU-FPGA[J]. COMPUTER JOURNAL,2023:9.
APA Dong, Dong,Jiang, Hongxu,&Diao, Boyu.(2023).AKGF: Automatic Kernel Generation for DNN on CPU-FPGA.COMPUTER JOURNAL,9.
MLA Dong, Dong,et al."AKGF: Automatic Kernel Generation for DNN on CPU-FPGA".COMPUTER JOURNAL (2023):9.

入库方式： OAI收割

来源：计算技术研究所

浏览0
下载0
收藏0
其他版本

除非特别说明，本系统中所有内容都受版权保护，并保留所有权利。