#NVFP4
1 articles tagged NVFP4. At twelve articles this topic starts lifting the whole site in search.
Timeline
All articles
-
Tech · 2 min readWhat is model quantization: how a 1.5TB AI model shrinks to 4 bits and fits on one server
Idea — store each number in 8 or 4 bits instead of 16