🚨 Survey Alert 🚨
Our paper "Back to recurrent processing at the crossroad of transformers and state-space models" is out in Nature Machine Intelligence!
🔗 www.nature.com/articles/s42...
Read it here: rdcu.be/el85K
#Mamba #SSMs #Transformers #LLMs
nature.com
Back to recurrent processing at the crossroad of transformers and state-space models - Nature Machine Intelligence
While transformers and large language models excel at efficiently processing long sequences, new approaches have been proposed that incorporate recurrence to overcome the quadratic cost of self-attent...