Questions tagged [hopfield-network]

For questions related to the Hopfield network, popularized by J. J. Hopfield in the paper "Neural networks and physical systems with emergent collective computational abilities" (1982).

Filter by
Sorted by
Tagged with
0 votes
0 answers
30 views

Why are rows of Attention Weights in a Hopfield Transformer the same?

I'm working on building a Hopfield Transformer using the github code from the paper (https://github.com/ml-jku/hopfield-layers/tree/master/hflayers) to forecast a timeseries dataset with 48 variables, ...
Ryan Bose-Roy's user avatar
1 vote
0 answers
18 views

Hopfield networks with shared neurons

Has there been research or even a thorough analysis of several Hopfield networks coupled by sets of shared neurons? Would this work? What about their respective storage capacities and robustness? Any ...
Hans-Peter Stricker's user avatar
0 votes
0 answers
17 views

Change in the Structure of Deep Associative Networks since their Inception

I am trying to understand how far associative networks have evolved from the Hopfield network. A lot of the research is only available to institutions which is why I deferred to this stack exchange. ...
DragonflyRobotics's user avatar
0 votes
1 answer
164 views

What is remembering in Hopfield network?

Hopfield is a simple and traditional network. We feed into the network some patterns (Learning/Training). There is no training in Hopfield as the weight calculation adds up all the strength between ...
David's user avatar
  • 111
3 votes
2 answers
129 views

Why some neural network models in the 1980s shown as circuit models

I am familiar with the currently popular neural network in deep learning, which has weights and is trained by gradient descent. However, I found many papers that were popular in the 1980s and 1990s. ...
dawen's user avatar
  • 131
1 vote
1 answer
310 views

Reasoning behind performance improvement with hopfield networks

In the paper Hopfield networks is all you need, the authors mention that their modern Hopfield network layers are a good replacement for pooling, GRU, LSTM, and attention layers, and tend to ...
Rijul Gupta's user avatar
4 votes
1 answer
455 views

Is there a rigorous proof for finding Hopfield minima?

I am looking for a rigorous mathematical proof for finding the several local minima of the Hopfield networks. I am searching for something rigorous, a demonstration, not just letting the network keep ...
lolodino77's user avatar
11 votes
1 answer
660 views

Can layers of deep neural networks be seen as Hopfield networks?

Hopfield networks are able to store a vector and retrieve it starting from a noisy version of it. They do so setting weights in order to minimize the energy function when all neurons are set equal to ...
Mario Alemi's user avatar