Unsloth lets users train local decision models on 4GB VRAM

Unsloth released an open-source method to fine-tune LLMs into decision models that run locally, lifting Qwen3.5 0.8B's aggregate accuracy from 20.7% to 74.3% across three decision benchmarks.

The team used a Clef head with LoRA (r=64) for one epoch on just 4GB VRAM, with the approach applicable to models such as Qwen3.8 and Gemma 4. A guide and notebooks are available on the Unsloth documentation site and GitHub.