Add a busy timeout for the LocalAI watchdog

LOCALAI_WATCHDOG_BUSY had no matching timeout setting, so the role
could only ever use LocalAI's built-in 5 minutes. On the throttled
Tesla T4 a legitimate request can take more than 6 minutes, so default
to 10 minutes, which also matches the ingress proxy-read-timeout.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
This commit is contained in:
2026-11-09 10:43:17 -05:00
co-authored by Claude Opus 5.5
parent 0559783297
commit dd5f03f074
2 changed files with 3 additions and 0 deletions
+2
View File
@@ -34,6 +34,8 @@
value: "{{ localai_watchdog_idle_timeout }}"
- name: LOCALAI_WATCHDOG_BUSY
value: "{{ localai_watchdog_busy }}"
- name: LOCALAI_WATCHDOG_BUSY_TIMEOUT
value: "{{ localai_watchdog_busy_timeout }}"
- name: DEBUG
value: "{{ localai_debug }}"
- name: LOCALAI_P2P