Fred Reveals the Transformer Encoder

Text on the meme

Transformer Encoder MLP Norm Multi-Head Attention Norm (Schmidhuber, 1991)

What it means

Fred Jones unwraps a bound, hooded figure to reveal Jürgen Schmidhuber. The joke claims that the Transformer encoder architecture was already described by Schmidhuber in 1991, humorously framing the modern AI breakthrough as an old idea in disguise. It is used as a reaction to discussions about the origins and originality of Transformers.

Who

Fred Jones (Scooby-Doo)Jürgen Schmidhuber

Objects

blond cartoon man / светловолосый мультяшный мужчина bound hooded person / связанный человек с капюшоном white sweater / белый свитер orange neckerchief / оранжевая косынка black cap / чёрная кепка beard / борода Transformer Encoder diagram / схема Transformer Encoder flowchart / блок-схема MLP box / блок MLP Norm boxes / блоки Norm Multi-Head Attention box / блок Multi-Head Attention arrows / стрелки dark blue background / тёмно-синий фон