LOCALAI_WATCHDOG_BUSY had no matching timeout setting, so the role
could only ever use LocalAI's built-in 5 minutes. On the throttled
Tesla T4 a legitimate request can take more than 6 minutes, so default
to 10 minutes, which also matches the ingress proxy-read-timeout.
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
- Keep agents, KB collections, users and runtime settings
(LOCALAI_DATA_PATH, LOCALAI_CONFIG_DIR) and backends
(LOCALAI_BACKENDS_PATH) on the models PVC. The chart's /data,
/configuration and /backends are ephemeral, so every pod restart wiped
the agent team and the llama.cpp backend.
- Default the agent pool to ornith-1.5-9b-q8 with
granite-embedding-107m-multilingual embeddings.
- Make the image tag a variable, defaulting to the CUDA 13 image that runs.
- Patch hostNetwork and the LOCALAI_P2P_TOKEN secretKeyRef (Secret
localai/localai-p2p) onto the Deployment after Helm. Both were set by
hand, and applying the role would otherwise revert them.
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
claudeandClaude Opus 5.5
