Learning by random walks in the weight space of the Ising perceptron
文献类型:期刊论文
作者 | Huang, HP ; Zhou, HJ |
刊名 | JOURNAL OF STATISTICAL MECHANICS-THEORY AND EXPERIMENT
![]() |
出版日期 | 2010 |
关键词 | CONSTRAINT SATISFACTION PROBLEMS NEURAL NETWORK MODELS BINARY PERCEPTRON STORAGE CAPACITY SYNAPSES ALGORITHM COUPLINGS PLASTICITY DYNAMICS |
ISSN号 | 1742-5468 |
通讯作者 | Huang, HP: Chinese Acad Sci, Key Lab Frontiers Theoret Phys, Inst Theoret Phys, Beijing 100190, Peoples R China. |
中文摘要 | Several variants of a stochastic local search process for constructing the synaptic weights of an Ising perceptron are studied. In this process, binary patterns are sequentially presented to the Ising perceptron and are then learned as the synaptic weight configuration is modified through a chain of single- or double-weight flips within the compatible weight configuration space of the earlier learned patterns. This process is able to reach a storage capacity of alpha approximate to 0.63 for pattern length N = 101 and alpha approximate to 0.41 for N = 1001. If in addition a relearning process is exploited, the learning performance is further improved to a storage capacity of alpha approximate to 0.80 for N = 101 and alpha approximate to 0.42 for N = 1001. We found that, for a given learning task, the solutions constructed by the random walk learning process are separated by a typical Hamming distance, which decreases with the constraint density a of the learning task; at a fixed value of a, the width of the Hamming distance distribution decreases with N. |
收录类别 | SCI |
资助信息 | National Science Foundation of China [10774150, 10834014]; China 973-Program [2007CB935903] |
语种 | 英语 |
公开日期 | 2013-09-18 |
源URL | [http://ir.iphy.ac.cn/handle/311004/40767] ![]() |
专题 | 物理研究所_物理所公开发表论文_物理所公开发表论文_期刊论文 |
推荐引用方式 GB/T 7714 | Huang, HP,Zhou, HJ. Learning by random walks in the weight space of the Ising perceptron[J]. JOURNAL OF STATISTICAL MECHANICS-THEORY AND EXPERIMENT,2010. |
APA | Huang, HP,&Zhou, HJ.(2010).Learning by random walks in the weight space of the Ising perceptron.JOURNAL OF STATISTICAL MECHANICS-THEORY AND EXPERIMENT. |
MLA | Huang, HP,et al."Learning by random walks in the weight space of the Ising perceptron".JOURNAL OF STATISTICAL MECHANICS-THEORY AND EXPERIMENT (2010). |
入库方式: OAI收割
来源:物理研究所
浏览0
下载0
收藏0
其他版本
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。