LM Studio
FreemiumPolished desktop GUI for discovering, quant-checking, and running Hugging Face GGUF & MLX models offline.
Free for individual desktop and workplace use under license terms; enterprise teams check org licensing
For users who prefer visual sliders over CLI flags, LM Studio pairs an intuitive Hugging Face model browser (showing green/yellow VRAM fit estimates before you download) with dual runtime support for both `llama.cpp` GGUF and Apple `MLX`. Click once to toggle local OpenAI-compatible server mode with full structured JSON output and context length controls.
Tip: Check the GPU offload slider and enable Flash Attention before benchmarking context windows above 32K—leaving partial layers on CPU slashes token speeds dramatically.