LocalAI deployment #24

New Issue

2025-10-29T12:55:17Z

eric commented

2025-10-29 12:55:17 +00:00

Having added the LOCALAI_WATCHDOG_IDLE values to the LocalAI deployment, running models in the homelab is now tenable. The deployment should have its own Ansible role, and additional roles should be created to deploy LocalAGI and LocalRecall as well.

Add the following Ansible role repos as submodules to this one:

Having added the `LOCALAI_WATCHDOG_IDLE` values to the LocalAI deployment, running models in the homelab is now tenable. The deployment should have its own Ansible role, and additional roles should be created to deploy LocalAGI and LocalRecall as well. Add the following Ansible role repos as submodules to this one: - [ ] [LocalAI](https://gitea.eom.dev/DevOps/ansible-role-localai) - [ ] [LocalAGI](https://gitea.eom.dev/DevOps/ansible-role-localagi) - [ ] [LocalRecall](https://gitea.eom.dev/DevOps/ansible-role-localrecall)

eric added a new dependency 2025-10-29 12:57:38 +00:00

DevOps/ansible-role-localai#1 - Create this repo

eric added a new dependency 2025-10-29 12:58:56 +00:00

DevOps/ansible-role-localagi#1 - Create this repo

eric added a new dependency 2025-10-29 12:59:44 +00:00

DevOps/ansible-role-localrecall#1 - Create this repo

eric added a new dependency 2025-10-29 13:20:25 +00:00

#25 Install the second Tesla T4 in the PowerEdge T640

Sign in to join this conversation.