Nate@nate_512

Follow

Kimi K3 runs on 8GB RAM

WAIT... YOU CAN NOW RUN A TWO POINT SEVEN TRILLION PARAMETER MODEL ON AN 8GB LAPTOP 🤯 The Kimi K3 engine achieves this with a 176KB binary written in portable C. It bypasses memory limits by streaming the 1.56TB weights directly from disk for every single token. → 8GB RAM gets you 26 seconds per token → 128GB RAM gets you 5 seconds per token Same exact math and byte identical results regardless of the machine. Zero GPUs required. This is pure brutalist engineering. Free and open-source. repo in 🧵↓

1h

Nate@nate_512

Follow

Kimi K3 runs on 8GB RAM

WAIT... YOU CAN NOW RUN A TWO POINT SEVEN TRILLION PARAMETER MODEL ON AN 8GB LAPTOP 🤯 The Kimi K3 engine achieves this with a 176KB binary written in portable C. It bypasses memory limits by streaming the 1.56TB weights directly from disk for every single token. → 8GB RAM gets you 26 seconds per token → 128GB RAM gets you 5 seconds per token Same exact math and byte identical results regardless of the machine. Zero GPUs required. This is pure brutalist engineering. Free and open-source. repo in 🧵↓

1h