中国科学院机构知识库网格
Chinese Academy of Sciences Institutional Repositories Grid
首页 机构 成果 学者
  
  1. CAS IR Grid
  2. 计算技术研究所
  3. 中国科学院计算技术研究所
  4. 中国科学院计算技术研究所期刊论文
  5. 英文
ParaML: A Polyvalent Multicore Accelerator for Machine Learning

文献类型：期刊论文

作者Zhou, Shengyuan2,3; Guo, Qi1,2; Du, Zidong1,2; Liu, Daofu1,2; Chen, Tianshi1,2,4; Li, Ling5; Liu, Shaoli1,2; Zhou, Jinhong1,2; Temam, Olivier6; Feng, Xiaobing7
刊名IEEE TRANSACTIONS ON COMPUTER-AIDED DESIGN OF INTEGRATED CIRCUITS AND SYSTEMS
出版日期2020-09-01
卷号39期号:9页码:1764-1777
ISSN号0278-0070
关键词Neural networks Machine learning Testing Support vector machines Linear regression Computers Computer architecture Accelerator machine learning (ML) techniques multicore accelerator
DOI10.1109/TCAD.2019.2927523
英文摘要In recent years, machine learning (ML) techniques are proven to be powerful tools in various emerging applications. Traditionally, ML techniques are processed on general-purpose CPUs and GPUs, but their energy efficiencies are limited due to their excessive support for flexibility. As an efficient alternative to CPUs/GPUs, hardware accelerators are still limited as they often accommodate only a single ML technique (family). However, different problems may require different ML techniques, which implies that such accelerators may achieve poor learning accuracy or even be ineffective. In this paper, we present a polyvalent accelerator architecture integrated with multiple processing cores, called ParaML, which accommodates ten representative ML techniques, including k-means, k-nearest neighbors (k-NN), naive Bayes (NB), support vector machine (SVM), linear regression (LR), classification tree (CT), deep neural network (DNN), learning vector quantization (LVQ), parzen window (PW), and principal component analysis (PCA). Benefited from our thorough analysis on computational primitives and locality properties of different ML techniques, the single-core ParaML can perform up to 1056 GOP/s (e.g., additions and multiplications) in an area of 3.51 mm(2) and consumes 596 mW only, estimated by ICC and PrimeTime PX with post-synthesis netlist, respectively. Compared with the NVIDIA K20M GPU (28-nm process), the single-core ParaML (65-nm process) is 1.21x faster, and can reduce the energy by 137.93x. We also compare the single-core ParaML with other accelerators. Compared with PRINS, single-core ParaML achieves 72.09x and 2.57x energy benefit for k-NN and k-means, respectively, and speeds up each query in k-NN by 44.76x. Compared with EIE, the single-core ParaML achieves 5.02x speedup and 4.97x energy benefit with 11.62x less area when evaluating with dense DNN. Compared with TPU, the single-core ParaML achieves 2.45x better power efficiency (5647 Gop/W versus 2300 Gop/W) with 321.36x less area. Compared to the single-core version, the 8-core ParaML will further improve the speedup up to 3.98x with an area of 13.44 mm(2) and a power of 2036 mW.
资助项目National Key Research and Development Program of China[2017YFA0700902] ; NSF of China[61432016] ; NSF of China[61532016] ; NSF of China[61672491] ; NSF of China[61602441] ; NSF of China[61602446] ; NSF of China[61732002] ; NSF of China[61702478] ; NSF of China[61732007] ; NSF of China[61732020] ; Beijing Natural Science Foundation[JQ18013] ; 973 Program of China[2015CB358800] ; National Science and Technology Major Project[2018ZX01031102] ; Transformation and Transfer of Scientific and Technological Achievements of Chinese Academy of Sciences[KFJ-HGZX-013] ; Key Research Projects in Frontier Science of Chinese Academy of Sciences[QYZDB-SSW-JSC001] ; Strategic Priority Research Program of Chinese Academy of Science[XDB32050200] ; Strategic Priority Research Program of Chinese Academy of Science[XDC01020000]
WOS研究方向Computer Science ; Engineering
语种英语
出版者IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
WOS记录号WOS:000562034400002
源URL[http://119.78.100.204/handle/2XEOYT63/15793]  
专题中国科学院计算技术研究所期刊论文_英文
通讯作者Guo, Qi
作者单位1.Cambricon Technol Corp Ltd, Beijing 100191, Peoples R China
2.Chinese Acad Sci, Inst Comp Technol, Intelligent Processor Res Ctr, Beijing 100190, Peoples R China
3.Univ Chinese Acad Sci, Sch Comp Sci & Technol, Beijing 100049, Peoples R China
4.CAS Ctr Excellence Brain Sci & Intelligence Techn, Beijing 100190, Peoples R China
5.Chinese Acad Sci, Inst Software, Beijing 100190, Peoples R China
6.Inria Scalay, F-91120 Palaiseau, France
7.Chinese Acad Sci, Inst Comp Technol, State Key Lab Comp Architecture, Beijing 100190, Peoples R China
8.Univ Sci & Technol China, Hefei 230026, Peoples R China
推荐引用方式
GB/T 7714		 Zhou, Shengyuan,Guo, Qi,Du, Zidong,et al. ParaML: A Polyvalent Multicore Accelerator for Machine Learning[J]. IEEE TRANSACTIONS ON COMPUTER-AIDED DESIGN OF INTEGRATED CIRCUITS AND SYSTEMS,2020,39(9):1764-1777.
APA Zhou, Shengyuan.,Guo, Qi.,Du, Zidong.,Liu, Daofu.,Chen, Tianshi.,...&Chen, Yunji.(2020).ParaML: A Polyvalent Multicore Accelerator for Machine Learning.IEEE TRANSACTIONS ON COMPUTER-AIDED DESIGN OF INTEGRATED CIRCUITS AND SYSTEMS,39(9),1764-1777.
MLA Zhou, Shengyuan,et al."ParaML: A Polyvalent Multicore Accelerator for Machine Learning".IEEE TRANSACTIONS ON COMPUTER-AIDED DESIGN OF INTEGRATED CIRCUITS AND SYSTEMS 39.9(2020):1764-1777.

入库方式： OAI收割

来源：计算技术研究所

浏览0
下载0
收藏0
其他版本

除非特别说明，本系统中所有内容都受版权保护，并保留所有权利。