Multi-modal models (text-to-text & image-to-text) are supported for System & Workspace scopes.
Local LLM Providers
- Built-in (default)
- Ollama:
https://ollama.com/ - LM Studio:
https://lmstudio.ai/ - Local AI:
https://localai.io/ - KoboldCPP:
https://github.com/LostRuins/koboldcpp - Text Generation WebUI:
https://github.com/oobabooga/text-generation-webui - Docker Model Runner:
https://docs.docker.com/desktop/features/model-runner/ - Lemonade:
https://lemonade-server.ai/
Cloud LLM Providers
- OpenAI:
https://platform.openai.com/ - Azure OpenAI:
https://azure.microsoft.com/en-us/products/ai-services/openai-service - AWS Bedrock:
https://aws.amazon.com/bedrock - Anthropic:
https://anthropic.com/ - Cohere:
https://cohere.com/ - Cerebras:
https://cerebras.ai/ - Google Gemini:
https://ai.google.dev/ - Hugging Face:
https://huggingface.co/ - Together AI:
https://www.together.ai/ - Fireworks AI:
https://fireworks.ai/ - OpenRouter:
https://openrouter.ai/ - Perplexity AI:
https://www.perplexity.ai/ - Mistral:
https://mistral.ai/ - Groq:
https://groq.com/ - LiteLLM:
https://litellm.ai/ - DeepSeek:
https://www.deepseek.com/ - APIPie:
https://apipie.ai/ - Novita AI:
https://novita.ai/ - xAI:
https://x.ai/ - NVIDIA NIM:
https://www.nvidia.com/en-us/ai/ - PPIO:
https://www.ppinfra.com/ - Dell Pro AI Studio:
https://www.dell.com/en-us/dt/solutions/artificial-intelligence/index.htm - Moonshot AI:
https://www.moonshot.cn/ - Comet API:
https://www.comet.com/ - Foundry:
https://www.foundrylocal.ai/ - zAI:
https://zai.chat/ - Gitee AI:
https://ai.gitee.com/ - SambaNova:
https://sambanova.ai/ - Minimax:
https://www.minimaxi.com/ - OpenAI (generic):
/anythingllm-setup/llm-configuration/cloud/openai-generic
Specialized Routing
- AnythingLLM Model Router:
/model-router/overview(Rule-based session routing to configured providers and models)