Thanks for the question. Ensuring that the network is designed for a range of form factors is a priority for the next version, Apertus 2.0. The current release (1.5, described in the blog above), is not an MoE model.
Apertus
@apertusllm.bsky.social
37 followers 4 following 7 posts
Developed by the Swiss AI Initiative as a collaborative effort between EPFL, ETH Zurich, and CSCS. Open weights, open data, open science.
