中国科学院机构知识库网格
Chinese Academy of Sciences Institutional Repositories Grid
首页 机构 成果 学者
  
  1. CAS IR Grid
  2. 计算技术研究所
  3. 中国科学院计算技术研究所
  4. 中国科学院计算技术研究所期刊论文
  5. 英文
Compiler-assisted Operator Template Library for DNN Accelerators

文献类型：期刊论文

作者Li, Jiansong1,2; Cao, Wei2; Dong, Xiao1,2; Li, Guangli1,2; Wang, Xueying1,2; Zhao, Peng1,2; Liu, Lei2; Feng, Xiaobing1,2
刊名INTERNATIONAL JOURNAL OF PARALLEL PROGRAMMING
出版日期2021-03-25
页码18
关键词DNN Accelerators Template Library Address Space Management
ISSN号0885-7458
DOI10.1007/s10766-021-00701-6
英文摘要Despite many dedicated accelerators are gaining popularity for their performance and energy efficiency in the deep neural network (DNN) domain, high-level programming support for these accelerators remains thin. In contrast to existing researches targeting the whole DNNs, we choose to dive into details and review this problem from a finer-grained level, operators. Due to performance concerns, operator programmers may have to take hand-written assembly as their first choice, which is error-prone and involves many programming chores. To alleviate this problem, we propose TOpLib, a compiler-assisted template library. By providing a unified user-view abstraction, TOpLib allows programmers to express computational kernels with high-level tensor primitives, which will be automatically lowered into low-level intrinsic primitives via expression templates. Moreover, considering memory management is performance-critical and the optimization strategy of expression template is limited to enumeration based rewriting rules, we implement TOpLib with a compiler-assisted approach. We address the memory reuse challenges into the compiler, which allows TOpLib to make full use of on-chip buffers and result in better performance. Experiments over 55 typical DNN operators demonstrate that TOpLib can generate scalable code with performance faster than or on par with hand-written assembly versions.
资助项目National Key R&D Program of China[2017YFB1003103] ; Science Fund for Creative Research Groups of the National Natural Science Foundation of China[61521092]
WOS研究方向Computer Science
语种英语
WOS记录号WOS:000632749100001
出版者SPRINGER/PLENUM PUBLISHERS
源URL[http://119.78.100.204/handle/2XEOYT63/16757]  
专题中国科学院计算技术研究所期刊论文_英文
通讯作者Li, Jiansong
作者单位1.Univ Chinese Acad Sci, Beijing, Peoples R China
2.Chinese Acad Sci, Inst Comp Technol, Beijing, Peoples R China
推荐引用方式
GB/T 7714		 Li, Jiansong,Cao, Wei,Dong, Xiao,et al. Compiler-assisted Operator Template Library for DNN Accelerators[J]. INTERNATIONAL JOURNAL OF PARALLEL PROGRAMMING,2021:18.
APA Li, Jiansong.,Cao, Wei.,Dong, Xiao.,Li, Guangli.,Wang, Xueying.,...&Feng, Xiaobing.(2021).Compiler-assisted Operator Template Library for DNN Accelerators.INTERNATIONAL JOURNAL OF PARALLEL PROGRAMMING,18.
MLA Li, Jiansong,et al."Compiler-assisted Operator Template Library for DNN Accelerators".INTERNATIONAL JOURNAL OF PARALLEL PROGRAMMING (2021):18.

入库方式： OAI收割

来源：计算技术研究所

浏览0
下载0
收藏0
其他版本

除非特别说明，本系统中所有内容都受版权保护，并保留所有权利。