LLMs work by predicting the next word based on everything before it. but always choosing the most likely word makes the answers too formulaic, so they added randomness by sometimes choosing the 2nd or 3rd most likely word instead. this can have a knock-on effect that changes the whole answer.