Overview

AnythingLLM Desktop includes a built-in local LLM engine supporting CPU and GPU execution for models such as Llama-3 and Phi-3.

Configuration & Management

  • Initial Setup: Select the target model to download during the first boot sequence. Track download progress in the top-right corner of the application interface.
  • Model Updates: Change or update the active model at any time via Settings.