For the past month or so, I've been slowly working through this book by @sebastianraschka.com which theoretically and practically builds a GPT model from scratch. Highly recommended!
Ironically, I'm writing much more code by hand as a result
Justin Norman, PhD
@justintime.ai
148 followers 499 following 389 posts
Researcher @ UC Berkeley You can also find me @ justintime.ai Washington Spirit | Mystics | Caps
![Mathematical notation and text statement describing the theoretical impossibility of completely eliminating hallucination in LLMs:
For an LLM h trained iteratively on a dataset T, there exists a computable function f such that for all training states h [i], the model cannot eliminate hallucinations completely:](https://cdn.bsky.app/img/feed_thumbnail/plain/did:plc:wuamqljqueipatn6mrwr74si/bafkreifhy5hnojywhwb73n45dtarrirj6zfgwudywjh35lqzn6psf6pwna)
