中国科学院机构知识库网格
Chinese Academy of Sciences Institutional Repositories Grid
首页 机构 成果 学者
  
  1. CAS IR Grid
  2. 数学与系统科学研究院
  3. 中国科学院数学与系统科学研究院
  4. 应用数学研究所
Interpreting the Basis Path Set in Neural Networks

文献类型：期刊论文

作者Zhu Juanping1; Meng Qi2; Chen Wei2; Ma Zhiming3
刊名JOURNAL OF SYSTEMS SCIENCE & COMPLEXITY
出版日期2021-01-12
页码13
关键词Basis path hierarchical algorithm independent path neural network substructure path
ISSN号1009-6124
DOI10.1007/s11424-020-0112-y
英文摘要The G-SGD algorithm significantly outperforms the conventional SGD algorithm in ReLU neural networks by adopting the basis path set. However, how the inner mechanism of basis paths works remains mysterious, and the G-SGD algorithm that helps to find a basis path set is heuristic. This paper employs graph theory to investigate structure properties of basis paths in a more general and complicated neural network with unbalanced layers and edge-skipping. The hierarchical Algorithm HBPS is proposed to find a basis path set, by decomposing the complicated network into several independent and parallel substructures. The paper theoretically extends the study of basis paths and provides one methodology to find the basis path set in a more general neural network.
资助项目National Nature Science Foundation of China[11601471] ; Project for Innovation Team (Cultivation) of Yunnan Province[202005AE160006] ; Key Project of Yunnan Provincial Science and Technology Department and Yunnan University[2018FY001014]
WOS研究方向Mathematics
语种英语
WOS记录号WOS:000608140200033
出版者SPRINGER HEIDELBERG
源URL[http://ir.amss.ac.cn/handle/2S8OKBNM/58043]  
专题应用数学研究所
通讯作者Zhu Juanping
作者单位1.Yunnan Univ, Dept Math, Kunming 650500, Yunnan, Peoples R China
2.Microsoft Res Asia, Beijing 100190, Peoples R China
3.Chinese Acad Sci, Acad Math & Syst Sci, Beijing 100190, Peoples R China
推荐引用方式
GB/T 7714		 Zhu Juanping,Meng Qi,Chen Wei,et al. Interpreting the Basis Path Set in Neural Networks[J]. JOURNAL OF SYSTEMS SCIENCE & COMPLEXITY,2021:13.
APA Zhu Juanping,Meng Qi,Chen Wei,&Ma Zhiming.(2021).Interpreting the Basis Path Set in Neural Networks.JOURNAL OF SYSTEMS SCIENCE & COMPLEXITY,13.
MLA Zhu Juanping,et al."Interpreting the Basis Path Set in Neural Networks".JOURNAL OF SYSTEMS SCIENCE & COMPLEXITY (2021):13.

入库方式： OAI收割

来源：数学与系统科学研究院

浏览0
下载0
收藏0
其他版本

除非特别说明，本系统中所有内容都受版权保护，并保留所有权利。