中国科学院机构知识库网格
Chinese Academy of Sciences Institutional Repositories Grid
Meta neurons improve spiking neural networks for efficient spatio-temporal learning

文献类型:期刊论文

作者Xiang Cheng1,2; Tielin Zhang1,2; Shuncheng Jia1,2; Bo Xu1,2,3
刊名Neurocomputing
出版日期2023-02-11
卷号531页码:217-225
英文摘要

Spiking neural networks (SNNs) have incorporated many biologically-plausible structures and learning principles, and hence are playing critical roles in bridging the gap between artificial and natural neural networks. The spike is a sparse membrane-potential signal describing the above-threshold event-based firing and under-threshold dynamic integration, which might be considered an alternative uniformed and efficient way of spatio-temporal information representation and computation. Nowadays, most SNNs have selected the leaky integrated-and-fire (LIF) neuron with 1st-order dynamics as a key feature of membrane potential integration. The LIF neuron is efficient in dynamic coding but still too simple com-pared to its biological counterpart, which could generate various types of firing patterns. Here we run fur-ther by defining some ‘‘meta” neuron models that contain 1st- or 2nd-order dynamics and a recovery variable to simulate the hyperpolarization. Both shallow and deep SNNs were used to test the efficiency and flexibility of meta neuron models in various benchmark machine learning tasks, containing spatial learning (e.g., MNIST, Fashion-MNIST, NETtalk, Cifar-10), temporal learning (e.g., TIDigits, TIMIT), and spatio-temporal learning (e.g., N-MNIST). SNNs using these meta neurons were optimized by backprop-agation with approximate gradient, and achieved markedly higher spatio-temporal capability without affecting accuracy, compared to those using regular LIF models.

源URL[http://ir.ia.ac.cn/handle/173211/58850]  
专题数字内容技术与服务研究中心_听觉模型与认知计算
通讯作者Tielin Zhang; Bo Xu
作者单位1.Institute of Automation, Chinese Academy of Sciences (CASIA), Beijing 100190, China
2.School of Artificial Intelligence, University of Chinese Academy of Sciences (UCAS), Beijing 100049, China
3.Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences, Shanghai 200031, China
推荐引用方式
GB/T 7714
Xiang Cheng,Tielin Zhang,Shuncheng Jia,et al. Meta neurons improve spiking neural networks for efficient spatio-temporal learning[J]. Neurocomputing,2023,531:217-225.
APA Xiang Cheng,Tielin Zhang,Shuncheng Jia,&Bo Xu.(2023).Meta neurons improve spiking neural networks for efficient spatio-temporal learning.Neurocomputing,531,217-225.
MLA Xiang Cheng,et al."Meta neurons improve spiking neural networks for efficient spatio-temporal learning".Neurocomputing 531(2023):217-225.

入库方式: OAI收割

来源:自动化研究所

浏览0
下载0
收藏0
其他版本

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。