Topic Model to Transformer: I’m in your base killing your dudes
proceedings.mlr.press/v202/li23p.h...
proceedings.mlr.press
How Do Transformers Learn Topic Structure: Towards a Mechanistic Understanding
While the successes of transformers across many domains are indisputable, accurate understanding of the learning mechanics is still largely lacking. Their capabilities have been probed on benchmark...