Reposted by @rishisonthalia.bsky.social
Permutation equivariance is a common property of multi-agent systems. In a new paper with Shiba Biswal and
@rishisonthalia.bsky.social
, accepted to ICML, we leverage this property shared by transformers, for mean field models of collective behavior.
#machinelearning
arxiv.org/abs/2410.16295
arxiv.org
Universal Approximation of Mean-Field Models via Transformers
This paper investigates the use of transformers to approximate the mean-field dynamics of interacting particle systems exhibiting collective behavior. Such systems are fundamental in modeling phenomen...
