You’ve launched me deep into the archives, but to Yud’s credit, here is a 2016 talk where he specifically says its “as if” the agents have a utility function. (Pic 1)
But then he spends the rest of the talk reasoning about specific utility functions so idk (pic 2)
