We have different definitions of "locally"
@unsloth.aiQwen3.8 can now be run locally! 🔥
We shrank Qwen3.8-2.4T-A95B from 4.9TB to 397GB (-91% size) via Dynamic 1-bit by selectively quantizing layers.
Run on 410GB+ RAM/VRAM via Unsloth Desktop.
Qwen3.8 rivals GPT-5.6 Sol.
Guide: unsloth.ai/docs/models/...
GGUF: huggingface.co/unsloth/Qwen...
