Prerequisites & Limitations

  • Model Requirement: Anthropic claude-3-5-sonnet (fixed). Bedrock and Vertex AI are not supported.
  • OS Support: Primary display only.
  • OS Permissions (macOS only):
    • Accessibility: Enable for AnythingLLM in System Settings > Privacy & Security > Accessibility (permits mouse/keyboard control).
    • Screen Recording: Enable for AnythingLLM in System Settings > Privacy & Security > Screen Recording (permits display screenshots).

Configuration

  1. Navigate to the Feature Preview Management page.
  2. Enable the Computer Use / OS Agent feature.
  3. Click Manage OS Agent Settings.
  4. Input and save your Anthropic API key.

Execution

To start the agent, enter the following command syntax in the AnythingLLM chat:

@os <prompt/task instructions>

Emergency Abort Methods

To immediately halt the OS Agent session:

  • Click the Pause icon on the floating control popup.
  • Press keyboard shortcut:
    • macOS: CMD + K
    • Windows/Linux: CTRL + K
  • Force quit the AnythingLLM desktop application.