I'm going to wait a few more days to truly celebrate... but Qwen 3.6 35b a3b is impressing me a lot right now. Full 256k context, 70+ tps supporting up to 4 concurrent streams off my gaming PC... and I just ran a couple quick coding tasks that it handled great.
Also, not used to models so... terse?
@jrw14.whnc.meYesterday's experiments with Strata and Qwen 3.8 Next made me realize what is possible with local inference.
I ran into some issues that were a bit disappointing with Strata last night, so I decided to try a similar approach, with a smaller MoE model to address concurrency.
DIDN'T EXPECT THIS!
