Most guides on RAG systems are over-optimizing for latency. If you are using RAG to automate any type of knowledge work, accuracy is much more important.
I explore the idea of spending more compute for RAG systems to significantly improve performance.
www.vivekkalyan.com/writing/scal...
vivekkalyan.com
Scaling Compute for RAG
Unlock higher RAG accuracy by strategically spending compute.
