GPT-6 Power Grid Problem

Spoke to a Microsoft engineer on the GPT-6 training cluster project. He kvetchеd about the pain they're having provisioning infiniband-class links between GPUs in different regions. Me: "why not just colocate the cluster in one region?" Him: "Oh yeah we tried that first. We can't put more than 100K H100s in a single state without bringing down the power grid." 🤯 This garbage is now officially worse than crypto.

A screenshot of a social media post describes a Microsoft engineer struggling to connect GPUs across regions for a GPT-6 training cluster. The joke is that concentrating enough AI hardware in one state would overload the power grid, making the absurd infrastructure demands of AI seem even worse than crypto. It is used as a reaction to the huge energy consumption and logistical problems of AI development. EN: A screenshot of a social media post describes a Microsoft engineer struggling to connect GPUs across regions for a GPT-6 training cluster. The joke is that concentrating enough AI hardware in one state would overload the power grid, making the absurd infrastructure demands of AI seem even worse than crypto. It is used as a reaction to the huge energy consumption and logistical problems of AI development.

• @gentoomemes / 18248 2025-08-16
• @antichirst / 20318 2025-08-16