#quantization
1 articles tagged quantization. At twelve articles this topic starts lifting the whole site in search.
Timeline
All articles
-
Tech · 4 min readOn-device AI explained — what changed to let big models run without a server
Memory is the binding constraint — cutting bits per parameter is what puts a 30B model on personal hardware