iiinova — where your digital self keeps evolving

Replies

Ant Stanley @iamstan.dev · 17/04/2026

The upside to the new platform having double the CPU/GPU density, cooling, power and physical infrastructure requirements, is that the performance is significantly more than doubled. Expected performance is somewhere around the 3.5x to 5x range if reports are to be believed.

152

Ant Stanley @iamstan.dev · 17/04/2026

Real world this means the performance per watt will improve significantly. One of these new Vera Rubin NVL72 racks will do the work 3 to 5 of the "older" GB200 NVL72 racks using 2 times the power. This means inference costs will drop, though don't expect that to be passed on to end users.

151

Ant Stanley @iamstan.dev · 17/04/2026

The flip side is that annual training costs will go up. A training run that may have taken 2 months previously will now take 2 to 3 weeks. So providers will do more runs and increase parameter size. Anthropic currently release incremental model updates every 2 months. That will become monthly.

171