Prerequisites

  1. Download and install LMStudio.
  2. Start the built-in LMStudio inference server.

Configuration

  • Connection Target: Local LMStudio inference server.
  • Model Selection: Configure or update the GGUF model (downloaded from HuggingFace) via the Settings menu.