A Character-level Short Text Classification Model Based On Spiking Neural Networks
文献类型:会议论文
作者 | Jiang, Chengzhi1,2![]() ![]() ![]() |
出版日期 | 2023-06 |
会议日期 | 2023.6.18-2023.6.23 |
会议地点 | Broadbeach, Australia |
关键词 | spiking neural networks character-level encoding ANN-to-SNN conversion short text classification |
英文摘要 | Spiking Neural Networks (SNNs), also referred to as the third generation of artificial neural networks, are highly prized for their biological realism, robustness, and low power requirements. SNNs are crucial in fields such as object detection, image recognition, etc. The classification of short text plays an significant role in the development of chatbots and intent detection. It is also an important task that is widely used in many downstream tasks. However, studies applying SNNs to short text classification are limited. This paper provides a new model that uses SNNs to classify short texts. SNNs are difficult to train directly when using deep models and cannot employ large-scale language models to learn good embeddings. To resolve the challenge, we apply the character-level encoding method and convert analog neural networks into SNNs. To begin with, we represent character-level text using a temporal-and-rate joint horizontal encoding method. Then we develop a tailored deep Convolutional Neural Network (CNN) model for classifying texts. At the inference stage, we convert the tailored CNN model into an SNN model. To test the effectiveness of the proposed method, we conduct text encoding experiments on the NAMES dataset and short text classification experiments on both the 20-newsgroups dataset and the emoji-mult dataset. Experiments demonstrate that the proposed method can obtain classification accuracies that are better than or comparable to other methods. |
源URL | [http://ir.ia.ac.cn/handle/173211/56574] ![]() |
专题 | 舆论大数据科学与技术应用联合实验室 |
通讯作者 | Li, Linjing |
作者单位 | 1.School of Artificial Intelligence, University of Chinese Academy of Sciences 2.Institute of Automation, Chinese Academy of Sciences |
推荐引用方式 GB/T 7714 | Jiang, Chengzhi,Li, Linjing,Zeng, Dajun,et al. A Character-level Short Text Classification Model Based On Spiking Neural Networks[C]. 见:. Broadbeach, Australia. 2023.6.18-2023.6.23. |
入库方式: OAI收割
来源:自动化研究所
其他版本
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。