Multi-LLM connections
By default, Hilal’s AI features run on a built-in provider with usage metered against your subscription. If you want to bring your own LLM keys (cheaper for high-volume usage, privacy preferences, or specific model selection), use the Multi-LLM connections page.
In this guide:
- Add a provider key
- Test the connection
- Pick the default model per AI surface
- Fall back to the built-in provider
Step 1: Add a provider key
Go to AI → LLM connections in the sidebar.
For each provider:
- OpenAI — paste your
sk-...key. - Anthropic — paste your
sk-ant-...key. - Google AI — paste your Google AI Studio key.
- Azure OpenAI — endpoint URL, deployment name, key.
Click Save. Hilal stores the key encrypted.
Step 2: Test the connection
Click Test on the provider card. Hilal runs a tiny round-trip (“respond with the word OK”) against the provider and reports success / failure with the raw error if it fails.
Don’t enable a provider for use until the test passes.
Step 3: Pick the default model per AI surface
Once at least one provider is connected, you can pick the default model per AI surface:
| Surface | Pick what |
|---|---|
| AI Chat | A chat model — GPT-4, Claude Sonnet, Gemini, etc. |
| NL2SQL | A model strong at code/SQL — GPT-4 or Claude Sonnet recommended. |
| AI Notes | Any chat model. |
| Document Chat | A model with strong context-window (Claude Opus, GPT-4 Turbo). |
| Image generation | Currently bundled-only; BYO keys not yet supported for image. |
Set defaults at AI → LLM connections → Defaults. You can override per surface in each surface’s settings.
Step 4: Fall back to the built-in provider
If your BYO provider has an outage, Hilal falls back to the built-in provider automatically (using your subscription’s metered quota). Disable the fallback per provider if you’d rather see an error.
Cost considerations
When you BYO keys:
- Hilal’s subscription AI quota is not consumed for that surface.
- You pay your provider directly for tokens.
- For high-volume sellers (heavy NL2SQL or AI Chat usage), BYO is usually cheaper than buying the Extra AI usage add-on.
Troubleshooting
- Test fails with 401 / unauthorized. Key is wrong or revoked. Regenerate at the provider and re-paste.
- Test fails with rate limit. The provider rate-limited the test. Wait a minute and try again.
- Fall-back triggered repeatedly. Your provider account is having issues — check your provider’s status page.