#Edge0
1 articles tagged Edge0. At twelve articles this topic starts lifting the whole site in search.
Timeline
All articles
-
Tech · 15 min readEdge0-145B specs — 145 billion parameters in 29GB? The download is 106GB
The arithmetic — fitting all 145 billion parameters in 29GB would take 1.6 bits each. The actual files are a 40GB expert pool plus a 51GB embedding table, about 106GB in total