#local AI
1 articles tagged local AI. At twelve articles this topic starts lifting the whole site in search.
Timeline
All articles
-
Tech · 2 min readWhat mixture of experts (MoE) is — how a 125B model runs on a gaming GPU
Structure — many 'experts' plus a router that picks a few per token: big in total, small in compute