Home Bookmarks Inbox Collections Profile

Recent Search

Command Palette

Search for a command to run...

Command Palette

Search for a command to run...

Inbox Collections Profile

Show HN: Running 104GB Qwen3.8-Flash-Next on 48GB Mac with at ~12 tok/s — Blankdot

github.com3 weeks ago

Show HN: Running 104GB Qwen3.8-Flash-Next on 48GB Mac with at ~12 tok/s

Show HN: Running 104GB Qwen3.8-Flash-Next on 48GB Mac with at ~12 tok/s

I built slotstream, a way to run Qwen3.8-Flash-Next 4-bit on a low-memory mac starting from 16GB, a 125B parameter model that would need 100GB+ memory/RAM, thanks to expert-offloading/ssd-streaming. Easy to install/update, and mac-native using MLX and Swift. It ships with auto-mode, which makes a…

Visit github.com

No discussion yet. Be the first to share your thoughts!