Keywords

Hopfield network, beam search

Abstract

In this paper we propose a beam search mechanism to improve the performance of the Hopfield network for solving optimization problems. The beam search readjusts the top M (M > 1) activated neurons to more similar activation levels in the early phase of relaxation, so that the network has the opportunity to explore more alternative, potentially better solutions. We evaluated this approach using a large number of simulations (20,000 for each parameter setting), based on 200 randomly generated city distributions of the 10-city traveling salesman problem. The results show that the beam search has the capability of significantly improving the network performance over the original Hopfield network, increasing the percentage of valid tours by 17.0% and reducing error rate by 24.3%.

Original Publication Citation

Zeng, X. and Martinez, T. R., "Improving the Hopfield Network through Beam Search", Proceedings of the IEEE International Joint Conference on Neural Networks IJCNN'1, pp. 1162-1167, 21.