Right. People say AIs are just “probable next word” machines.
But if I say “What’s the answer to this famously unsolved math problem?” giving the “probable next word” requires a conceptual model capable of solving the problem.
At some point accurate prediction requires comprehensive understanding.
@catblanketflower.yuwakisa.comIn order to predict the next token it needs to understand the tokens that came before. Otherwise the response wouldn’t be coherent
