This is why early chatgpt was so bad at math, btw. All it really knows is that x + y needs to equal z, but it doesn't know that 2+2=4, it just recognizes that it's an equation and that it needs to output a number. They fixed this by making it fed inputs into a calculator if it detects an equation