#on-device AI
2 articles tagged on-device AI. At twelve articles this topic starts lifting the whole site in search.
Timeline
-
Meta put a 30B agent model on a laptop — Apache 2.0, no server required
-
On-device AI explained — what changed to let big models run without a server
All articles
-
Tech · 3 min readMeta put a 30B agent model on a laptop — Apache 2.0, no server required
Muse Glimmer 30B — distilled from Muse Spark 1.2, weights released under Apache 2.0
-
Tech · 4 min readOn-device AI explained — what changed to let big models run without a server
Memory is the binding constraint — cutting bits per parameter is what puts a 30B model on personal hardware