Home Explore Bookmarks Inbox Collections Profile

Recent Search

Command Palette

Search for a command to run...

Command Palette

Search for a command to run...

Home Explore Bookmarks

Inbox Collections Profile

Show HN: Open-source engine running Gemma 4 26B in 2 GB RAM on any M-series Mac — Blankdot

github.com5 days ago

Show HN: Open-source engine running Gemma 4 26B in 2 GB RAM on any M-series Mac

Show HN: Open-source engine running Gemma 4 26B in 2 GB RAM on any M-series Mac

Hi HN, I built a specialized inference engine for running 4-bit Gemma 4 26B-A4B-IT on any M-series Mac using about 2 GB of RAM. It is called TurboFieldfare and is written in Swift and Metal. I have always adored on-device AI. It feels like magic that you can run a powerful NN on your Mac or iPhone.…

Visit github.com

1

No discussion yet. Be the first to share your thoughts!