Nate@nate_512

Follow

Soup 8B local fine-tuning

Meet Soup, a new open-source CLI under Apache 2.0 that lets you fine-tune an 8B model completely locally on a laptop with just a 4 GB GPU. It uses layer streaming to bypass VRAM limits entirely so you can fine-tune and post-train LLMs in one command without SSH or config hell. This is brilliant. Check out trysoup.dev, see the pypi page for v0.73.3 (Python 3.10-3.12), or check its Product Hunt listing. #Tech

3w

Nate@nate_512

Follow

Soup 8B local fine-tuning

Meet Soup, a new open-source CLI under Apache 2.0 that lets you fine-tune an 8B model completely locally on a laptop with just a 4 GB GPU. It uses layer streaming to bypass VRAM limits entirely so you can fine-tune and post-train LLMs in one command without SSH or config hell. This is brilliant. Check out trysoup.dev, see the pypi page for v0.73.3 (Python 3.10-3.12), or check its Product Hunt listing. #Tech

3w