Ran the same function through six languages and a real tokenizer. Go: 50 tokens. Java: 59. Lisp, hand-golfed: 27.
A language's grammar decides what every call site pays for, whether the reader or the model needs it or not.
#foss #programming #ai
dwightaspencer.com/posts/26-lisp-token-cost/