Prerequisites

  1. Download and install LMStudio.
  2. Load the target embedding GGUF model in LM Studio.
  3. Start the built-in LM Studio inference server.

Connection

Connect your application to the local LM Studio inference server endpoint. Model updates can be configured via the settings menu.