AnythingLLM

import-custom

1 min read

Import GGUF directly (AnythingLLM Desktop Only)

Note: Embedder models are not supported for this method.

  1. Navigate to the LLM selection screen.
  2. Click Import custom model.
  3. Select the local GGUF file.
  4. Wait 2-3 minutes for the import process to complete.
  5. Select and save the imported model.

Alternative: Import to LMStudio

  1. Locate the LMStudio local model directory.
  2. Drag and drop the GGUF folder/file into the LMStudio model location.

Graph View