unsloth
A free, open-source desktop app to run and train LLMs and diffusion models locally, with up to 2× faster fine-tuning and 70% less VRAM.
Unsloth is the first desktop app to run and train AI models locally. It supports a wide range of models including Qwen3.8, Kimi K3, MiniMax-H3, Gemma 4, DeepSeek-V4, and FLUX. Unlike most local model tools that focus only on inference, Unsloth adds a full training stack: fine-tune LLMs, diffusion, TTS, and embedding models 2× faster with 70% less VRAM. It also supports LoRA, QLoRA, RL, GRPO, DPO, and FP8. The app includes built-in Agents & Tools integration (Claude Code, Codex, MCP), private search and RAG, image/video diffusion, and audio support. With hardware support for CPU, NVIDIA, AMD, Intel, macOS, and multi-GPU setups, plus remote access via Cloudflare, Unsloth is a comprehensive local AI studio. It can export to GGUF, NVFP4, FP8 and offers an OpenAI-compatible API for easy deployment.