Physical Data arrangement is going to be so, so important in the future.
Say you want to match an H200 in bandwidth (~4.8TB/s), but with the new kid on the block, High-Bandwidth Flash (HBF).
(Keep in mind, HBF is *attempting* to compete in the same arena as HBM, as a cheaper alt).