#MoE
3 articles tagged MoE. At twelve articles this topic starts lifting the whole site in search.
Timeline
-
What mixture of experts (MoE) is — how a 125B model runs on a gaming GPU
-
What 'open-source AI' actually means — licences, weights, MoE
-
LG open-sources a 750B model — K-EXAONE 2.0 under Apache 2.0
All articles
-
Tech · 2 min readWhat mixture of experts (MoE) is — how a 125B model runs on a gaming GPU
Structure — many 'experts' plus a router that picks a few per token: big in total, small in compute
-
Tech · 2 min readWhat 'open-source AI' actually means — licences, weights, MoE
'Open-source model' is not one thing — openness runs from weights-only to full disclosure
-
Tech · 1 min readLG open-sources a 750B model — K-EXAONE 2.0 under Apache 2.0
K-EXAONE 2.0 ships under Apache 2.0 — commercial use, modification and redistribution allowed