Logo image
Back
On the State Space of the Binary Neural Network
Conference proceeding

On the State Space of the Binary Neural Network

Moshe Kam, Roger Cheng and Allon Guez
1988 American Control Conference, v 88, pp 2276-2281
Jun 1988
DOI: https://doi.org/10.23919/ACC.1988.4790104

Abstract

Content based retrieval Convergence Hamming distance Hopfield neural networks Information analysis Information retrieval Neural networks Pattern analysis Pattern recognition State-space methods
Analysis of the state space for the fully-connected binary neural network ("the Hopfield model") remains an important objective in utilizing the network in pattern recognition and associative information retrieval. Most of the research pertaining to the network's state space so far concentrated on stable-state enumeration and often it was assumed that the patterns which are to be stored are random. We discuss the case of deterministic known codewords whose storage is required, and show that for this important case bounds on the retrieval probabilities and convergence rates can be achieved. The main tool which we employ is Birth-and-Death Markov chains, describing the Hamming distance of the network's state from the stored patterns. The results are applicable to both the asynchronous network and to the Boltzmann machine, and can be utilized to compare codeword sets in terms of efficiency of their retrieval, when the neural network is used as a content addressable memory.

Metrics

9 Record Views

Details

Logo image