AnythingLLM

chat-modes

1 min read

Workspace Configuration

  • Change Chat Mode: Workspace Settings -> Chat Settings (Gear icon) -> Select Mode.
  • Similarity Threshold: Workspace Settings -> Vector Database Settings -> Document similarity threshold -> Select:
    • No restriction (Recommended for troubleshooting)
    • Low (≥ 0.25)
    • Medium (≥ 0.50)
    • High (≥ 0.75)
  • Disable Native Tool Calling: Set environment variable PROVIDER_DISABLE_NATIVE_TOOL_CALLING=true to force prompt-based tool calling.

Chat Modes Reference

Agent Mode (Default)

  • Behavior: Automates tasks using agent-skills, tools, and Model Context Protocol (MCP).
  • Dependency: Requires native tool-calling LLM capability.
  • Execution:
    • If @ indicator is visible in prompt input: Prefix query with @agent.
    • If @ indicator is absent: Agent mode is active by default.

Chat Mode

  • Behavior: Combines uploaded document contexts with LLM general knowledge.
  • Use Case: Conversational responses, brainstorming, contextual explanations.

Query Mode

  • Behavior: Restricts LLM responses strictly to uploaded document contexts. Returns “No relevant information found” if no match exists.
  • Use Case: Factual retrieval, technical documentation Q&A, hallucination prevention.

Troubleshooting “No relevant information found” (Query Mode)

  1. Relax Similarity Limits: Set “Document similarity threshold” to “No restriction”.
  2. Align Vocabulary: Match query terms to exact document terminology (e.g., query “initialize the application” instead of “start the app”).

Graph View