Deploy LocalAI #26

Open
opened 2025-03-08 16:57:40 +00:00 by eric · 1 comment
Owner

With the Nvidia GPU available in K8s, LocalAI can be deployed using a helm chart.

With the Nvidia GPU available in K8s, LocalAI can be deployed using a helm chart.
eric added a new dependency 2025-03-08 16:58:04 +00:00
eric added a new dependency 2025-03-08 16:58:24 +00:00
Author
Owner

This deployment was straight forward, but resulted in a pod with pending status. More work is needed to utilize GPUs in K8s.

This deployment was straight forward, but resulted in a pod with pending status. More work is needed to utilize GPUs in K8s.
eric added a new dependency 2025-03-08 19:53:55 +00:00
Sign in to join this conversation.
No Label
No Milestone
No project
No Assignees
1 Participants
Notifications
Due Date
The due date is invalid or out of range. Please use the format 'yyyy-mm-dd'.

No due date set.

Blocks
#19 Nextcloud Assistant
DevOps/ansible-role-eom
Depends on
#10 NVIDIA Tesla T4
DevOps/software-infrastructure
#13 Disk pressure on alpha-worker-0
DevOps/software-infrastructure
Reference: DevOps/ansible-role-eom#26
No description provided.