LLM providers overview

Use one provider page below for exact setup and examples:

• OpenAI
• Azure OpenAI
• Gemini
• Anthropic
• AWS Bedrock
• LM Studio
• Groq
• Mistral
• Ollama
• OpenRouter
• Vercel AI Gateway

​

Supported provider values

• openai
• azure_openai
• gemini
• anthropic
• bedrock
• lmstudio
• groq
• mistral
• ollama
• openrouter
• ai_gateway

​

Required profile fields

Each llm.profiles.<name> entry requires:

• provider
• model

Optional profile fields:

• system_prompt
• user_prompt
• prompt (deprecated)

​

Prompt variables

These placeholders are available in prompt, system_prompt, and user_prompt:

• {{source}}
• {{target}}
• {{input}}