中国科学院机构知识库网格
Chinese Academy of Sciences Institutional Repositories Grid
A Character-level Short Text Classification Model Based On Spiking Neural Networks

文献类型:会议论文

作者Jiang, Chengzhi1,2; Li, Linjing2; Zeng, Dajun1,2; Wang, Xiaoxuan2
出版日期2023-06
会议日期2023.6.18-2023.6.23
会议地点Broadbeach, Australia
关键词spiking neural networks character-level encoding ANN-to-SNN conversion short text classification
英文摘要

Spiking Neural Networks (SNNs), also referred to as the third generation of artificial neural networks, are highly prized for their biological realism, robustness, and low power requirements. SNNs are crucial in fields such as object detection, image recognition, etc. The classification of short text plays an significant role in the development of chatbots and intent detection. It is also an important task that is widely used in many downstream tasks. However, studies applying SNNs to short text classification are limited. This paper provides a new model that uses SNNs to classify short texts. SNNs are difficult to train directly when using deep models and cannot employ large-scale language models to learn good embeddings. To resolve the challenge, we apply the character-level encoding method and convert analog neural networks into SNNs. To begin with, we represent character-level text using a temporal-and-rate joint horizontal encoding method. Then we develop a tailored deep Convolutional Neural Network (CNN) model for classifying texts. At the inference stage, we convert the tailored CNN model into an SNN model. To test the effectiveness of the proposed method, we conduct text encoding experiments on the NAMES dataset and short text classification experiments on both the 20-newsgroups dataset and the emoji-mult dataset. Experiments demonstrate that the proposed method can obtain classification accuracies that are better than or comparable to other methods.

源URL[http://ir.ia.ac.cn/handle/173211/56574]  
专题舆论大数据科学与技术应用联合实验室
通讯作者Li, Linjing
作者单位1.School of Artificial Intelligence, University of Chinese Academy of Sciences
2.Institute of Automation, Chinese Academy of Sciences
推荐引用方式
GB/T 7714
Jiang, Chengzhi,Li, Linjing,Zeng, Dajun,et al. A Character-level Short Text Classification Model Based On Spiking Neural Networks[C]. 见:. Broadbeach, Australia. 2023.6.18-2023.6.23.

入库方式: OAI收割

来源:自动化研究所

浏览0
下载0
收藏0
其他版本

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。