Llm Config

Generated

This page is generated from qa/operations/specs/llm-config.md — the source of truth. Edit the spec, not this page.

Last run: not yet recorded (run the replay suite to populate status).

Overview

The operator configures the platform-default World-Agent LLM from the cockpit’s LLM config surface: a global, non-ruleset setting that selects the provider, model, and credential the authoring flow resolves when there is no customer tenant. Configuration is versioned and append-only — each save activates a new version (deactivating the prior), the history lists every version newest-first, and the operator can roll back to a prior version (which re-activates its config as a new version). The credential is write-only — entered here, stored encrypted, and never shown again.

This spec drives that surface end to end against the running cockpit. It is credential-free: setting a model is a control-plane DB write (the entered key is stored, not exercised), so it replays without any live LLM call.

Preconditions

• Signed in as the seeded operator.
• The LLM-config surface is reachable from the left rail (“LLM config”).

Scenarios

1. Reach the surface from the rail

• From the workbench, click the “LLM config” rail destination
• Expected: The URL is /llm-config and the set-model form is shown.

2. Set the global model

• Choose a provider (Anthropic), enter a model (claude-sonnet-4-6) and a write-only API key
• Save
• Expected: The active-model card appears, naming the canonical anthropic/claude-sonnet-4-6 model id and reporting the credential as set.

3. Version history lists the active version

• After a save, open the version history
• Expected: The history lists at least one version, and the newest (the just-saved config) is marked active.

4. A second save appends a new active version

• Set a different model (xAI grok-4.3) with its own key
• Expected: The active card now names xai/grok-4.3 at a higher version than before, and the history carries both versions — only the newest is active.

5. Roll back to a prior version

• Roll back to the earlier (Anthropic) version
• Expected: A new active version is created carrying the rolled-back config — the active card names anthropic/claude-sonnet-4-6 again, at a version newer than the xAI one (append-only; rollback never rewrites history).

6. openai-compatible reveals the base-URL field

• Choose the openai-compatible provider
• Expected: A required base-URL field appears; choosing any other provider hides it again.

Test Data

Label	Value	Notes
Provider A	anthropic / claude-sonnet-4-6	First saved version
Provider B	xai / grok-4.3	Second saved version
API key	a throwaway sk-… string	Write-only; stored, never exercised in replay