Providers and models
Offer cloud models in addition to the local model, set usage limits and keep track of access.
By default, LOKI answers with its own model Loki, which runs on the appliance. Under Providers & Models, administrators can also offer models from cloud providers, for example when a larger model is wanted for certain tasks.
Data leaves the organisation
If someone chooses a cloud model in the chat, questions, chat history, attachments and the content that LOKI draws from documents, e-mails or databases go to that provider. Check beforehand whether this is compatible with your data protection and contractual rules, and create compliance policies if needed.
Creating a provider
A provider is access to a cloud provider, with one or more models.
Open the form
Under Providers & Models, click Create new.
Connection
- Type: Anthropic, OpenAI, OpenAI-compatible, Google Gemini, Mistral AI, Cohere, Groq or DeepSeek.
- Name (optional): if you leave the field empty, LOKI assigns a name.
- API Key: the access key you get from the provider. LOKI stores it encrypted and never shows it again. When you save, LOKI checks the key directly with the provider.
- Endpoint URL: only needed for OpenAI-compatible; the address of the service.
Usage (optional)
Set usage limits (see below).
Models
Under Models, choose a Model from the list of suggestions (for OpenAI-compatible, type it in freely), give it a Label under which it appears in the chat, and click Add. Repeat this for further models.
Save
Click Save.
| Message | Meaning |
|---|---|
| “The API key was rejected.” | The key is wrong or does not match the chosen type. |
| “This API key is already used by another provider.” | Each key may only be used once. |
Who sees which models?
All models of all providers are available to everyone in the chat, in addition to the local model. There is no way to restrict them to certain groups.
Usage limits
For each provider, you can limit under Usage how many tokens (pieces of text) may be used. The limit applies to all models of the provider and all people together.
- Switch on Daily, Weekly and/or Monthly and enter a value for each. 0 means no limit.
- If several limits are set, whichever is reached first applies.
- From 80 per cent, people see a notice in the chat.
- At 100 per cent, the chat automatically switches to the local model until the limit is free again. An answer in progress stops at the limit instead of exceeding it.
A bar shows the current usage for each limit. In the list, too, clicking a provider's name opens its models and usage.
There are no limits per person or per group. The local model has no limit.
Keeping track of access to external models
Under Providers & Models › External Access, LOKI lists the requests that went to a cloud model: Time, User, Model and the number of tokens. The list does not show any content. Use search and the filters for date, user and model to find individual entries.
Editing and deleting providers
The pencil in the list opens the form. If you leave API Key empty, the stored key is kept. You delete a provider with the bin icon; its models then disappear from the chat. This cannot be undone.