SOURCE-LINKED INTELLIGENCE

Hierarchical Prototype Emergence in Modern Hopfield Models

arXiv · AI, language, vision and robotics · article · Sep 10, 2026 · UTC

Hierarchical correlations are a universal feature of any realistic model of data, and the question of how associative memory models may learn these correlations and generalize beyond them to construct new sensible images is an important step towards understanding more complex modern architectures such as diffusion models. We consider a hierarchical model for memories which are sampled and stored in a dense Hopfield network with polynomial activation. We analytically derive conditions for each level of this hierarchy to be locally stable - that is they are local energy minima. We use prototype

Read original source ↗ Open in workspace

recordType

paper

region

Global