Qwen4’s architecture is here early, firing 6B parameters out of 125B
Alibaba’s Qwen team has released Qwen3.8-Flash-Next, an open-weight preview of the architecture it intends to use for Qwen4, carrying 125B parameters but activating only 6B for each token. Its licence may not qualify for the EU AI Act’s open-source exemption. Alibaba’s Qwen team has published the…
No discussion yet. Be the first to share your thoughts!