All You Need Is Hopfield Networks

Attention Is All You Need BERT T5 CTRL GPT-3 Megatron Hopfield Networks is All You Need Jukebox Sea2sed Alphastar Transformer-XL GPT-2 Luong Bahdanau iGPT Wait—it's all Hopfield networks? Always has been

A space scene shows two astronauts looking at a diagram of neural-network models and realizing that everything is secretly Hopfield networks. The joke parodies the “Always has been” meme format and the paper title “Attention Is All You Need,” humorously claiming that modern AI breakthroughs are all variations of an older concept. EN: A space scene shows two astronauts looking at a diagram of neural-network models and realizing that everything is secretly Hopfield networks. The joke parodies the “Always has been” meme format and the paper title “Attention Is All You Need,” humorously claiming that modern AI breakthroughs are all variations of an older concept.

• @profunctor_io / 5109 2020-08-12