feat(local-ai): update image docker.io/localai/localai v4.1.3 → v4.2.0 (#48128)
> ℹ️ **Note** > > This PR body was truncated due to platform limits. This PR contains the following updates: | Package | Update | Change | |---|---|---| | [docker.io/localai/localai](https://redirect.github.com/mudler/LocalAI) | minor | `a6af99e` → `70c670f` | --- > [!WARNING] > Some dependencies could not be looked up. Check the [Dependency Dashboard](../issues/18710) for more information. Add the preset `:preserveSemverRanges` to your config if you don't want to pin your dependencies. --- ### Release Notes <details> <summary>mudler/LocalAI (docker.io/localai/localai)</summary> ### [`v4.2.0`](https://redirect.github.com/mudler/LocalAI/releases/tag/v4.2.0) [Compare Source](https://redirect.github.com/mudler/LocalAI/compare/v4.1.3...v4.2.0) ### 🎉 LocalAI 4.2.0 Release! 🚀 <h1 align="center"> <br> <img height="300" src="https://raw.githubusercontent.com/mudler/LocalAI/refs/heads/master/core/http/static/logo.png"> <br> <br> </h1> LocalAI 4.2.0 is out! This release teaches LocalAI to **see and hear**. New `/v1/voice/*` and `/v1/audio/diarization` endpoints, a full face-recognition pipeline with **antispoofing**, word-level timestamps for faster-whisper, and a client-cancellable Whisper. There is also a **drop-in Ollama API**, **video generation** in stable-diffusion.ggml, a redesigned chat with **i18n** and **admin-configurable branding**, **eleven** new backends, an interactive **model config editor** with autocomplete, and a hardened **distributed mode v2**. vLLM finally hits feature parity with llama.cpp and gets tensor-parallel distributed workers. *** #### 📌 TL;DR | Feature | Summary | | ---------------------------------- | -------------------------------------------------------------------------------------------------------------------------------------------------- | | 🎙️ **Voice Recognition** | New `/v1/voice/*`. Verify, identify, embed and analyze speakers. | | 👤 **Face Recognition + Liveness** | 1:1 verify, 1:N identify, detect, analyze, embed, and reject spoofed photos. | | 🎬 **Diarization** | New `/v1/audio/diarization` endpoint, "who spoke when?" via sherpa-onnx + vibevoice.cpp. | | 🗣️ **Better Transcriptions** | Word-level timestamps, client-cancellable Whisper, segments + duration + language on the stream-done event. | | 🦙 **Ollama API** | Drop-in compatibility. Point your `ollama` client straight at LocalAI. | | 🎬 **Video Generation** | `stable-diffusion.ggml` now generates video (i2v, first-last-frame). | | 💬 **Redesigned UI** | Chat redesign, Nord palette, **i18n** (5 languages), admin-configurable branding. | | ✏️ **Interactive Model Editor** | Autocomplete-driven config editor in the UI. | | 📦 **Universal Importer** | Imports across most backends, not just llama.cpp. | | 🚦 **Concurrency Groups** | Per-model exclusive groups for safe backend loading. | | 🧪 **11 New Backends** | sglang, ik-llama-cpp, TurboQuant, sam.cpp, Kokoros, qwen3tts.cpp, tinygrad-multimodal, LocalVQE, vibevoice-cpp, insightface (liveness), voice-rec. | | ⚡ **vLLM @​ parity** | Feature parity with llama.cpp + tensor-parallel distributed workers + full `engine_args`. | | 🛰️ **Distributed v2** | Hardened orchestrator, round-robin replicas, scoped Upgrade All, NATS install/upgrade split. | *** #### 🚀 New Features & Major Enhancements ##### 🎙️ Voice Recognition LocalAI is now ears-on. New `/v1/voice/*` endpoints let you verify, identify, analyze and embed speakers, powered by a SpeechBrain + ONNX Python backend. - **1:1 Verify**, "is this the same speaker?" - **1:N Identify**, "who is talking, out of my enrolled users?" - **Embeddings**, voice fingerprints for your own pipelines - **Analyze**, age, gender, emotion attributes per segment > 🔥 Pairs naturally with the new diarization endpoint for full speaker pipelines. <https://github.com/user-attachments/assets/3777decd-d82b-42f5-a4e1-43f2da44e6c8> *** ##### 👤 Face Recognition & Antispoofing A complete face-biometrics pipeline, built on **InsightFace + ONNX**. - **1:1 Verify**, match two faces - **1:N Identify**, resolve a face against an enrolled set - **Detection & Analysis**, find faces, extract attributes (age, gender, emotion, race) - **Embeddings**, facial fingerprints for your own stack - 🆕 **Antispoofing (liveness)**, reject spoofed photos and videos > ✅ Samples never leave your machine. They go only to the running backend. <https://github.com/user-attachments/assets/37c1271e-b1e3-4b5d-a1b4-f8d870051da3> *** ##### 🎬 Diarization & a smarter audio pipeline Audio is a first-class citizen now. - **`/v1/audio/diarization`**, segments speech by speaker turn (sherpa-onnx + vibevoice.cpp) - **Word-level timestamps** for faster-whisper - **Client cancellation** for Whisper via the ggml `abort_callback`. Stop a transcription mid-flight and free the GPU. - **Stream-done metadata** on `/v1/audio/transcriptions`. `segments`, `duration` and `language` on the final event. - **Audio transformations UI** (LocalVQE), explore audio FX directly from the React UI - **Transcription error visibility**, handler errors land in the access log and on the client *** ##### 🦙 Ollama drop-in API Point your existing **Ollama** client at LocalAI. Everything keeps working. Another front door, same engine. ```sh OLLAMA_HOST=http://localhost:8080 ollama run qwen3 ``` *** ##### 🎬 Video Generation The `stable-diffusion.ggml` backend now generates **video**, with curated gallery entries for **Wan 2.1 FLF2V 14B 720P** and **Wan i2v 720p**, plus a new `stablediffusion-ggml-development` meta backend to track the cutting edge. *** ##### 🎨 React UI: total refresh A massive UI cycle landed in 4.2: - 💬 **Chat redesign**, cleaner layout, faster perceived latency, better message density - 🎨 **Editorial refresh** with the Nord palette, calmer, more focused, dark-mode-first - 🌍 **Multilingual / i18n**, English, Italiano, Español, Deutsch, 简体中文 - 🪪 **Brandable instance**, admin-configurable name, tagline, and assets (logo, favicon) - ✏️ **Interactive model config editor**, autocomplete over known fields, live validation, automatic file-renaming on save - 🧰 **Backend management UX**, revamped backend list with concrete versions - 🛟 **Better error UX**, distributed backend management errors surface cleanly > 💡 Self-host with **your** branding. The login page, sidebar, footer, and browser tab all pick up the instance name and logo. <https://github.com/user-attachments/assets/91a7a8c8-15e8-4bd7-b97b-64fe0466bbd7> <https://github.com/user-attachments/assets/369e0dc7-87ba-4303-8193-24eda03fdb1f> *** ##### 🔄 Backend & model lifecycle - **Backend versioning** with automatic upgrade detection - **Pin models** so they survive the reaper - **On-demand toggle** per model to control auto-load - **Concurrency groups**, per-model exclusive groups so heavy backends won't trample each other - **Universal importer**, single flow that imports across most backends, with clean multi-shard GGUF handling and dedicated importers for **vibevoice-cpp** and **whisper.cpp** HF repos <https://github.com/user-attachments/assets/3d3be7ea-2601-4284-9a89-358ae99a926e> <https://github.com/user-attachments/assets/f13c5ca9-f174-48c0-9aee-e3406d50e607> *** ##### 🧪 New Backends! | Backend | What it brings | | ---------------------------------------- | ---------------------------------------------------------------------------- | | **sglang** | High-throughput LLM serving + speculative decoding (EAGLE/EAGLE3/DFLASH/MTP) | | **ik-llama.cpp** | ikawrakow's llama.cpp fork | | **TurboQuant** | Quant-focused llama.cpp fork | | **sam.cpp** | Segment Anything detection | | **Kokoros** | Rust-native Kokoro TTS | | **qwen3tts.cpp** | Qwen3 TTS | | **tinygrad-multimodal** *(experimental)* | tinygrad-powered multimodal | | **vibevoice.cpp** | Diarization-grade speech | | **LocalVQE** | Audio transformations / FX | | **insightface** | Face antispoofing | | **voice-rec** | Speaker recognition / embeddings | *** ##### ⚡ vLLM at parity (and beyond) - **vLLM parity** with llama.cpp, same feature surface, same ergonomics - **vLLM `engine_args`**, the full `AsyncEngineArgs` exposed via a generic YAML map - **Tensor-parallel distributed workers**, fan a single model across nodes - **CUDA 13** builds for vLLM, vLLM-omni and sglang - **L4T arm64 (CUDA 13)**, vLLM/vLLM-omni/sglang variants for Jetson-class arm64 - **MLX backend** refactored, shared helpers and enhanced functionality - **llama.cpp `split_mode`** for explicit multi-GPU placement - **Speculative decoding** wired through for llama.cpp, **Gemma 4 thinking** support added - **Vision / mtmd marker** propagated from the backend via `ModelMetadata` *** ##### 🛰️ Distributed Mode v2 Distributed mode keeps maturing. This release was a hardening pass across the orchestration loop: - **Orchestrator resilience**, auto-upgrade routing, worker bind-wait, RAG-init crash, log-spam fixes - **Round-robin** across replicas of the same model - **Upgrade All** scoped to nodes that actually have the backend installed - **NATS install / upgrade split**, `backend.upgrade` no longer piggybacks on install - **Cached-replica lookup honors NodeSelector**, the reconciler no longer scales up empty backends - **VRAM/RAM reporting** correct on NVIDIA unified-memory hosts - **Agent nodes**, queue loops stop on teardown, dead-letter cap added - **Autoscaling**, load-model extracted from `Route()` and applied during autoscale *** ##### 🔐 Auth & Security - **Settings API**, env-supplied `ApiKeys` are stripped before persisting (no accidental leaks) - **grpc-server hardening**, removed unsafe `sprintf()` in the C++ grpc server - **OIDC**, bumped `go-oidc/v3` to 3.18.0 - **Security hardening pass** across the codebase - **AI coding assistants policy**, LocalAI now follows the Linux kernel's DCO/attribution guidelines (`Assisted-by:` trailer, no AI co-authors) *** ##### 🖥️ Hardware & deployment - **CUDA 13** for vLLM, vLLM-omni, and sglang - **NVIDIA L4T arm64 (CUDA 13)** for Jetson-class boards - **ROCm 7.x** bumped to latest - **gfx1151** (Strix Halo / Ryzen AI MAX) support, `AMDGPU_TARGETS` exposed as a build-arg - **Intel GPU**, latest oneapi-basekit (b70 support) across Intel images - **arm64 CI**, cpu-whisperx and cpu-faster-whisper now ship arm64 images - **whisperx**, ROCm/HIPBLAS target dropped (pinned to rocm6.4 wheels) *** #### 🛠️ Under the Hood - **Better CLI errors** with actionable guidance - **golangci-lint baseline** (`new-from-merge-base`) keeps drift in check - **Coding-agent discoverability**, new APIs let coding agents introspect and configure LocalAI - **Autoparser**, prefers backend-emitted chat deltas, correct logprob passthrough, strips partial reasoning tags during warm-up - **Reasoning + tools**, no more empty content from thinking models in retry loops - **Streaming hygiene**, deduped content, deduped tool calls, recovered reasoning, unique `tool_call` IDs in deferred flushes - **HTTP**, handler-error status now visible in the access log + transcription error surface - **Backend monitor** accepts `model` as a query parameter - **Config loader**, YAML backup files are ignored - **GGUF thinking probe** respects explicit `reasoning` config - **Inference defaults** refreshed from Unsloth - **Embeddings on collection upload**, dim changes handled gracefully - **Python backends**, JIT subprocesses use `tempfile.gettempdir()` instead of hardcoded `/tmp` - **Draft model paths**, relative paths now resolve against the models dir - **whisper-cpp**: implement streaming transcription and context cancellation *** #### 🐞 Notable fixes - **Cascading user deletion** on PostgreSQL, deleting a user removes all owned data - **Importer** emits all shards for multi-part GGUF models - **Open Responses** parses OpenAI-spec nested `tool_choice` and uses the correct setter - **llama-cpp**: `server-chat.cpp` included in grpc-server TU, `common -> llama-common` rename, turboquant `common.h` detection - **ik-llama-cpp**: adapted to `common_grammar` in `sampling.h`, patched `clip.cpp` for the new `ggml_quantize_chunk` signature - **Kokoros**: trait stubs (`face_verify`, `face_analyze`, `audio_transcription_stream`), CI publish - **stable-diffusion.ggml**: MP4 container forced in ffmpeg mux, new i2v options - **Gallery**: orphaned meta-backend uninstall, gemma-4 URIs, flux-kontext param overrides, Wan dedup, z-image-turbo load, **Qwen3.5 typo override**, tag-casing normalization - **Streaming**: content + tool-call dedup, reasoning recovery, unique tool-call IDs in deferred flush - **Realtime**: consume ChatDeltas when the C++ autoparser clears `Response` - **Tool-calls**: use `SetFunctionCallNameString` when forcing a specific tool - **Faster-whisper**: cast segment timestamps to int after multiplication - **mlx-vlm**: pinned to v0.4.4 to unblock CUDA builds - **vLLM**: dropped flash-attn wheel to avoid torch 2.10 ABI mismatch - **Downloader**: list supported URL schemes in `DownloadFile` errors - **Backend**: resolve relative `draft_model` paths against the models dir - **CI**: wire `AMDGPU_TARGETS` through the backend workflow, switch gallery-agent to `sigs.k8s.io/yaml`, recover rerankers + vllm-omni on aarch64, unbreak master CI for docs/kokoros/vibevoice-cpp ABI *** #### 🆕 Gallery additions - **Wan 2.1 FLF2V 14B 720P** (video) - **Wan i2v 720p** (image-to-video) - **stablediffusion-ggml-development** meta backend - **chroma1-hd** (diffusers) - **Gemma 4** (+ mmproj) - **EmbeddingGemma** - **Qwen 3.5**, **Qwen-ASR**, **OCR** entries for llama.cpp - **Qwen3-VL Reranker**, **Qwen3-VL Embedding** (tagged) - A steady stream of automated **gallery-agent** model additions throughout the cycle 🤖 *** #### 🚀 The Complete Local Stack for Privacy-First AI <table> <tr> <td width="30%" valign="top" align="center"> <a href="https://redirect.github.com/mudler/LocalAI"> <img src="https://raw.githubusercontent.com/mudler/LocalAI/refs/heads/master/core/http/static/logo.png" width="200" alt="LocalAI Logo"> <h3>LocalAI</h3> </a> </td> <td width="70%" valign="top"> <p>The free, Open Source OpenAI alternative. Drop-in REST API compatible with OpenAI specs for local AI inferencing. No GPU required.</p> <p><em>Link:</em> <a href="https://redirect.github.com/mudler/LocalAI">https://github.com/mudler/LocalAI</a></p> </td> </tr> <tr> <td width="30%" valign="top" align="center"> <a href="https://redirect.github.com/mudler/LocalAGI"> <img src="https://raw.githubusercontent.com/mudler/LocalAGI/refs/heads/main/webui/react-ui/public/logo_2.png" width="200" alt="LocalAGI Logo"> <h3>LocalAGI</h3> </a> </td> <td width="70%" valign="top"> <p>Local AI agent management platform. Drop-in for OpenAI's Responses API, with advanced agentic capabilities and a no-code UI.</p> <p><em>Link:</em> <a href="https://redirect.github.com/mudler/LocalAGI">https://github.com/mudler/LocalAGI</a></p> </td> </tr> <tr> <td width="30%" valign="top" align="center"> <a href="https://redirect.github.com/mudler/LocalRecall"> <img src="https://raw.githubusercontent.com/mudler/LocalRecall/refs/heads/main/static/localrecall_horizontal.png" width="200" alt="LocalRecall Logo"> <h3>LocalRecall</h3> </a> </td> <td width="70%" valign="top"> <p>RESTful API and knowledge-base management providing persistent memory and storage for AI agents. Pairs with LocalAI and LocalAGI.</p> <p><em>Link:</em> <a href="https://redirect.github.com/mudler/LocalRecall">https://github.com/mudler/LocalRecall</a></p> </td> </tr> </table> *** #### ❤️ Thank You LocalAI is a true FOSS movement, built by contributors, powered by community. If you believe in privacy-first, self-hosted AI: - ⭐ **Star** the repo - 💬 **Contribute** code, docs, translations or feedback - 📣 **Share** with others Your support keeps this stack alive. *** #### ✅ Full Changelog <details> <summary>📋 Click to expand full changelog</summary> <!-- Release notes generated using configuration in .github/release.yml at master --> #### What's Changed ##### Bug fixes 🐛 - fix(autoscaling): extract load model from Route() and use as well when doing autoscale by [@​mudler](https://redirect.github.com/mudler) in [#​9270](https://redirect.github.com/mudler/LocalAI/pull/9270) - fix(nodes): better detection if nodes goes down or model is not available by [@​mudler](https://redirect.github.com/mudler) in [#​9274](https://redirect.github.com/mudler/LocalAI/pull/9274) - fix: try to add whisperx and faster-whisper for more variants by [@​mudler](https://redirect.github.com/mudler) in [#​9278](https://redirect.github.com/mudler/LocalAI/pull/9278) - fix: thinking models with tools returning empty content (reasoning-only retry loop) by [@​mudler](https://redirect.github.com/mudler) in [#​9290](https://redirect.github.com/mudler/LocalAI/pull/9290) - fix(streaming): deduplicate tool call emissions during streaming by [@​mudler](https://redirect.github.com/mudler) in [#​9292](https://redirect.github.com/mudler/LocalAI/pull/9292) - fix(streaming): skip chat deltas for role-init elements to prevent first token duplication by [@​mudler](https://redirect.github.com/mudler) in [#​9299](https://redirect.github.com/mudler/LocalAI/pull/9299) - Fix load of z-image-turbo by [@​thelittlefireman](https://redirect.github.com/thelittlefireman) in [#​9264](https://redirect.github.com/mudler/LocalAI/pull/9264) - fix(agents): handle embedding model dim changes on collection upload by [@​mudler](https://redirect.github.com/mudler) in [#​9365](https://redirect.github.com/mudler/LocalAI/pull/9365) - fix(gallery): correct gemma-4 model URIs returning 404 by [@​mvanhorn](https://redirect.github.com/mvanhorn) in [#​9379](https://redirect.github.com/mudler/LocalAI/pull/9379) - fix(ui): rename model config files on save to prevent duplicates by [@​mudler](https://redirect.github.com/mudler) in [#​9388](https://redirect.github.com/mudler/LocalAI/pull/9388) - fix(ci): switch gallery-agent to sigs.k8s.io/yaml by [@​mudler](https://redirect.github.com/mudler) in [#​9397](https://redirect.github.com/mudler/LocalAI/pull/9397) - fix(llama-cpp): rename linked target common -> llama-common by [@​mudler](https://redirect.github.com/mudler) in [#​9408](https://redirect.github.com/mudler/LocalAI/pull/9408) - fix(vision): propagate mtmd media marker from backend via ModelMetadata by [@​mudler](https://redirect.github.com/mudler) in [#​9412](https://redirect.github.com/mudler/LocalAI/pull/9412) - fix(turboquant): resolve common.h by detecting llama-common vs common target by [@​mudler](https://redirect.github.com/mudler) in [#​9413](https://redirect.github.com/mudler/LocalAI/pull/9413) - fix(rocm): add gfx1151 support and expose AMDGPU\_TARGETS build-arg by [@​keithmattix](https://redirect.github.com/keithmattix) in [#​9410](https://redirect.github.com/mudler/LocalAI/pull/9410) - fix(kokoros): implement audio\_transcription\_stream trait stub by [@​mudler](https://redirect.github.com/mudler) in [#​9422](https://redirect.github.com/mudler/LocalAI/pull/9422) - fix(turboquant): drop ignore-eos patch, bump fork to b8967-627ebbc by [@​mudler](https://redirect.github.com/mudler) in [#​9423](https://redirect.github.com/mudler/LocalAI/pull/9423) - fix(distributed): stop queue loops on agent nodes + dead-letter cap by [@​mudler](https://redirect.github.com/mudler) in [#​9433](https://redirect.github.com/mudler/LocalAI/pull/9433) - fix(gallery): allow uninstalling orphaned meta backends + force reinstall by [@​mudler](https://redirect.github.com/mudler) in [#​9434](https://redirect.github.com/mudler/LocalAI/pull/9434) - fix(stable-diffusion.ggml): force mp4 container in ffmpeg mux by [@​mudler](https://redirect.github.com/mudler) in [#​9435](https://redirect.github.com/mudler/LocalAI/pull/9435) - fix(settings): strip env-supplied ApiKeys from the request before persisting by [@​SAY-5](https://redirect.github.com/SAY-5) in [#​9438](https://redirect.github.com/mudler/LocalAI/pull/9438) - fix(api): remove duplicate /api/traces endpoint that broke React UI by [@​pjbrzozowski](https://redirect.github.com/pjbrzozowski) in [#​9427](https://redirect.github.com/mudler/LocalAI/pull/9427) - fix(distributed): pass ExternalURI through NATS backend install by [@​russell](https://redirect.github.com/russell) in [#​9446](https://redirect.github.com/mudler/LocalAI/pull/9446) - fix(ci): wire AMDGPU\_TARGETS through backend build workflow by [@​russell](https://redirect.github.com/russell) in [#​9445](https://redirect.github.com/mudler/LocalAI/pull/9445) - fix(config): ignore yaml backup files in model loader by [@​leinasi2014](https://redirect.github.com/leinasi2014) in [#​9443](https://redirect.github.com/mudler/LocalAI/pull/9443) - \[gallery] Fix duplicate sha256 keys in Wan models by [@​sec171](https://redirect.github.com/sec171) in [#​9461](https://redirect.github.com/mudler/LocalAI/pull/9461) - fix(tests): update InstallBackend call sites for new URI/Name/Alias params by [@​mudler](https://redirect.github.com/mudler) in [#​9467](https://redirect.github.com/mudler/LocalAI/pull/9467) - Fix: Add model parameter to neutts-air gallery definition by [@​localai-bot](https://redirect.github.com/localai-bot) in [#​8793](https://redirect.github.com/mudler/LocalAI/pull/8793) - fix(gallery-agent): process blacklist command on recently-closed PRs by [@​mudler](https://redirect.github.com/mudler) in [#​9473](https://redirect.github.com/mudler/LocalAI/pull/9473) - Respect explicit reasoning config during GGUF thinking probe by [@​leinasi2014](https://redirect.github.com/leinasi2014) in [#​9463](https://redirect.github.com/mudler/LocalAI/pull/9463) - fix(streaming): dedupe content, recover reasoning, unique tool\_call IDs in deferred flush by [@​mudler](https://redirect.github.com/mudler) in [#​9470](https://redirect.github.com/mudler/LocalAI/pull/9470) - fix(backend-monitor): accept model as a query parameter by [@​Dennisadira](https://redirect.github.com/Dennisadira) in [#​9411](https://redirect.github.com/mudler/LocalAI/pull/9411) - fix(kokoros): Build and publish the backend images from CI/CD by [@​richiejp](https://redirect.github.com/richiejp) in [#​9487](https://redirect.github.com/mudler/LocalAI/pull/9487) - fix: remove unsafe sprintf() in grpc-server.cpp by [@​orbisai0security](https://redirect.github.com/orbisai0security) in [#​9486](https://redirect.github.com/mudler/LocalAI/pull/9486) - fix(kokoros): implement face\_verify and face\_analyze trait stubs by [@​mudler](https://redirect.github.com/mudler) in [#​9499](https://redirect.github.com/mudler/LocalAI/pull/9499) - fix(ik-llama-cpp): adapt to common\_grammar struct in sampling.h by [@​mudler](https://redirect.github.com/mudler) in [#​9512](https://redirect.github.com/mudler/LocalAI/pull/9512) - fix(llama-cpp): include server-chat.cpp in grpc-server translation unit by [@​mudler](https://redirect.github.com/mudler) in [#​9511](https://redirect.github.com/mudler/LocalAI/pull/9511) - fix(importer): emit all shards for multi-part GGUF models by [@​mudler](https://redirect.github.com/mudler) in [#​9513](https://redirect.github.com/mudler/LocalAI/pull/9513) - fix(openresponses): parse OpenAI-spec nested tool\_choice + use correct setter by [@​walcz-de](https://redirect.github.com/walcz-de) in [#​9509](https://redirect.github.com/mudler/LocalAI/pull/9509) - fix: use SetFunctionCallNameString when forcing a specific tool (3 sites) by [@​Anai-Guo](https://redirect.github.com/Anai-Guo) in [#​9526](https://redirect.github.com/mudler/LocalAI/pull/9526) - fix(ik-llama-cpp): patch clip.cpp for new ggml\_quantize\_chunk signature by [@​mudler](https://redirect.github.com/mudler) in [#​9531](https://redirect.github.com/mudler/LocalAI/pull/9531) - fix(realtime): consume ChatDeltas when C++ autoparser clears Response by [@​richiejp](https://redirect.github.com/richiejp) in [#​9538](https://redirect.github.com/mudler/LocalAI/pull/9538) - fix: add hipblaslt library by [@​eglia](https://redirect.github.com/eglia) in [#​9541](https://redirect.github.com/mudler/LocalAI/pull/9541) - fix(distributed): correct VRAM/RAM reporting on NVIDIA unified-memory hosts by [@​mudler](https://redirect.github.com/mudler) in [#​9545](https://redirect.github.com/mudler/LocalAI/pull/9545) - fix(vllm): drop flash-attn wheel to avoid torch 2.10 ABI mismatch by [@​richiejp](https://redirect.github.com/richiejp) in [#​9557](https://redirect.github.com/mudler/LocalAI/pull/9557) - fix(mlx-vlm): pin upstream to v0.4.4 to unblock CUDA builds by [@​mudler](https://redirect.github.com/mudler) in [#​9568](https://redirect.github.com/mudler/LocalAI/pull/9568) - fix(gallery): normalize inconsistent tag casing/plurals across gallery models by [@​Anai-Guo](https://redirect.github.com/Anai-Guo) in [#​9574](https://redirect.github.com/mudler/LocalAI/pull/9574) - fix(gallery): correct Qwen3.5 typo in qwen3.5-27b-claude-4.6 model override (closes [#​9362](https://redirect.github.com/mudler/LocalAI/issues/9362)) by [@​Anai-Guo](https://redirect.github.com/Anai-Guo) in [#​9580](https://redirect.github.com/mudler/LocalAI/pull/9580) - fix(diffusers): drop compel from requirements to unblock pip resolver by [@​mudler](https://redirect.github.com/mudler) in [#​9632](https://redirect.github.com/mudler/LocalAI/pull/9632) - fix(ci): fix AMDGPU\_TARGETS empty-string bypass in hipblas builds by [@​russell](https://redirect.github.com/russell) in [#​9626](https://redirect.github.com/mudler/LocalAI/pull/9626) - fix(distributed): honor NodeSelector in cached-replica lookup, stop empty-backend reconciler scaleups by [@​localai-bot](https://redirect.github.com/localai-bot) in [#​9652](https://redirect.github.com/mudler/LocalAI/pull/9652) - fix(distributed): orchestrator resilience — auto-upgrade routing, worker bind-wait, RAG-init crash, log spam by [@​localai-bot](https://redirect.github.com/localai-bot) in [#​9657](https://redirect.github.com/mudler/LocalAI/pull/9657) - fix(faster-whisper): cast segment timestamps to int after multiplication by [@​arteven](https://redirect.github.com/arteven) in [#​9674](https://redirect.github.com/mudler/LocalAI/pull/9674) - fix(python-backend): make JIT subprocesses work on hosts of any size by [@​richiejp](https://redirect.github.com/richiejp) in [#​9679](https://redirect.github.com/mudler/LocalAI/pull/9679) - fix(distributed): scope Upgrade All to nodes that have the backend installed by [@​mudler](https://redirect.github.com/mudler) in [#​9678](https://redirect.github.com/mudler/LocalAI/pull/9678) - fix(backend): resolve relative draft\_model paths against the models dir by [@​localai-bot](https://redirect.github.com/localai-bot) in [#​9680](https://redirect.github.com/mudler/LocalAI/pull/9680) - fix: unbreak master CI (docs, kokoros, vibevoice-cpp ABI) by [@​localai-bot](https://redirect.github.com/localai-bot) in [#​9682](https://redirect.github.com/mudler/LocalAI/pull/9682) - fix(ci): unbreak rerankers (torch bump) and vllm-omni on aarch64 by [@​localai-bot](https://redirect.github.com/localai-bot) in [#​9688](https://redirect.github.com/mudler/LocalAI/pull/9688) - fix(distributed): round-robin replicas of the same model by [@​localai-bot](https://redirect.github.com/localai-bot) in [#​9695](https://redirect.github.com/mudler/LocalAI/pull/9695) - fix(downloader): list supported URL schemes in DownloadFile error by [@​Anai-Guo](https://redirect.github.com/Anai-Guo) in [#​9689](https://redirect.github.com/mudler/LocalAI/pull/9689) - fix(auth): cascade user deletion across all owned data on PostgreSQL by [@​localai-bot](https://redirect.github.com/localai-bot) in [#​9702](https://redirect.github.com/mudler/LocalAI/pull/9702) - fix(http): make handler-error status visible in access log + transcription errors by [@​localai-bot](https://redirect.github.com/localai-bot) in [#​9707](https://redirect.github.com/mudler/LocalAI/pull/9707) - fix(distributed): make backend upgrade actually re-install on workers by [@​localai-bot](https://redirect.github.com/localai-bot) in [#​9708](https://redirect.github.com/mudler/LocalAI/pull/9708) - fix(distributed): split NATS backend.upgrade off install + dedup loads by [@​localai-bot](https://redirect.github.com/localai-bot) in [#​9717](https://redirect.github.com/mudler/LocalAI/pull/9717) - fix(gallery): keep auto-upgrade off non-dev backends when -development is installed by [@​mudler](https://redirect.github.com/mudler) in [#​9736](https://redirect.github.com/mudler/LocalAI/pull/9736) ##### Exciting New Features 🎉 - feat(ui): Interactive model config editor with autocomplete by [@​richiejp](https://redirect.github.com/richiejp) in [#​9149](https://redirect.github.com/mudler/LocalAI/pull/9149) - feat: track files being staged by [@​mudler](https://redirect.github.com/mudler) in [#​9275](https://redirect.github.com/mudler/LocalAI/pull/9275) - feat: Add Kokoros backend by [@​richiejp](https://redirect.github.com/richiejp) in [#​9212](https://redirect.github.com/mudler/LocalAI/pull/9212) - feat(api): add ollama compatibility by [@​mudler](https://redirect.github.com/mudler) in [#​9284](https://redirect.github.com/mudler/LocalAI/pull/9284) - feat(sam.cpp): add sam.cpp detection backend by [@​mudler](https://redirect.github.com/mudler) in [#​9288](https://redirect.github.com/mudler/LocalAI/pull/9288) - feat(swagger): update swagger by [@​localai-bot](https://redirect.github.com/localai-bot) in [#​9300](https://redirect.github.com/mudler/LocalAI/pull/9300) - chore(qwen3-asr): pass prompt as context to transcribe by [@​mudler](https://redirect.github.com/mudler) in [#​9301](https://redirect.github.com/mudler/LocalAI/pull/9301) - feat: Add toggle mechanism to enable/disable models from loading on demand by [@​neurocis](https://redirect.github.com/neurocis) in [#​9304](https://redirect.github.com/mudler/LocalAI/pull/9304) - feat: allow to pin models and skip from reaping by [@​mudler](https://redirect.github.com/mudler) in [#​9309](https://redirect.github.com/mudler/LocalAI/pull/9309) - feat(swagger): update swagger by [@​localai-bot](https://redirect.github.com/localai-bot) in [#​9310](https://redirect.github.com/mudler/LocalAI/pull/9310) - feat: backend versioning, upgrade detection and auto-upgrade by [@​mudler](https://redirect.github.com/mudler) in [#​9315](https://redirect.github.com/mudler/LocalAI/pull/9315) - feat(swagger): update swagger by [@​localai-bot](https://redirect.github.com/localai-bot) in [#​9318](https://redirect.github.com/mudler/LocalAI/pull/9318) - feat(qwen3tts.cpp): add new backend by [@​mudler](https://redirect.github.com/mudler) in [#​9316](https://redirect.github.com/mudler/LocalAI/pull/9316) - feat(ux): backend management enhancement by [@​mudler](https://redirect.github.com/mudler) in [#​9325](https://redirect.github.com/mudler/LocalAI/pull/9325) - feat(rocm): bump to 7.x by [@​mudler](https://redirect.github.com/mudler) in [#​9323](https://redirect.github.com/mudler/LocalAI/pull/9323) - feat(backends): add ik-llama-cpp by [@​mudler](https://redirect.github.com/mudler) in [#​9326](https://redirect.github.com/mudler/LocalAI/pull/9326) - feat(swagger): update swagger by [@​localai-bot](https://redirect.github.com/localai-bot) in [#​9329](https://redirect.github.com/mudler/LocalAI/pull/9329) - feat(vllm): parity with llama.cpp backend by [@​mudler](https://redirect.github.com/mudler) in [#​9328](https://redirect.github.com/mudler/LocalAI/pull/9328) - feat: refactor shared helpers and enhance MLX backend functionality by [@​mudler](https://redirect.github.com/mudler) in [#​9335](https://redirect.github.com/mudler/LocalAI/pull/9335) - feat: wire transcription for llama.cpp, add streaming support by [@​mudler](https://redirect.github.com/mudler) in [#​9353](https://redirect.github.com/mudler/LocalAI/pull/9353) - feat(backend): add turboquant llama.cpp-fork backend by [@​mudler](https://redirect.github.com/mudler) in [#​9355](https://redirect.github.com/mudler/LocalAI/pull/9355) - feat(swagger): update swagger by [@​localai-bot](https://redirect.github.com/localai-bot) in [#​9356](https://redirect.github.com/mudler/LocalAI/pull/9356) - feat(backend): add tinygrad multimodal backend (experimental) by [@​mudler](https://redirect.github.com/mudler) in [#​9364](https://redirect.github.com/mudler/LocalAI/pull/9364) - feat(backends): add sglang by [@​mudler](https://redirect.github.com/mudler) in [#​9359](https://redirect.github.com/mudler/LocalAI/pull/9359) - refactor(tinygrad): reuse tinygrad.apps.llm instead of vendored Transformer by [@​mudler](https://redirect.github.com/mudler) in [#​9380](https://redirect.github.com/mudler/LocalAI/pull/9380) - feat(stable-diffusion.ggml): add support for video generation by [@​mudler](https://redirect.github.com/mudler) in [#​9420](https://redirect.github.com/mudler/LocalAI/pull/9420) - feat(distributed): sync state with frontends, better backend management reporting by [@​mudler](https://redirect.github.com/mudler) in [#​9426](https://redirect.github.com/mudler/LocalAI/pull/9426) - feat(swagger): update swagger by [@​localai-bot](https://redirect.github.com/localai-bot) in [#​9431](https://redirect.github.com/mudler/LocalAI/pull/9431) - feat(gallery): add Wan 2.1 FLF2V 14B 720P by [@​mudler](https://redirect.github.com/mudler) in [#​9440](https://redirect.github.com/mudler/LocalAI/pull/9440) - feat(gallery): add wan i2v 720p by [@​mudler](https://redirect.github.com/mudler) in [#​9457](https://redirect.github.com/mudler/LocalAI/pull/9457) - feat: improve CLI error messages with actionable guidance by [@​localai-bot](https://redirect.github.com/localai-bot) in [#​8880](https://redirect.github.com/mudler/LocalAI/pull/8880) - chore(whisperx): drop ROCm/hipblas build target by [@​mudler](https://redirect.github.com/mudler) in [#​9474](https://redirect.github.com/mudler/LocalAI/pull/9474) - feat(face-recognition): add insightface/onnx backend for 1:1 verify, 1:N identify, embedding, detection, analysis by [@​mudler](https://redirect.github.com/mudler) in [#​9480](https://redirect.github.com/mudler/LocalAI/pull/9480) - feat(importer): expand importer flow to almost all backends by [@​mudler](https://redirect.github.com/mudler) in [#​9466](https://redirect.github.com/mudler/LocalAI/pull/9466) - feat(swagger): update swagger by [@​localai-bot](https://redirect.github.com/localai-bot) in [#​9498](https://redirect.github.com/mudler/LocalAI/pull/9498) - feat: voice recognition by [@​mudler](https://redirect.github.com/mudler) in [#​9500](https://redirect.github.com/mudler/LocalAI/pull/9500) - feat(insightface): add antispoofing (liveness) detection by [@​mudler](https://redirect.github.com/mudler) in [#​9515](https://redirect.github.com/mudler/LocalAI/pull/9515) - feat(swagger): update swagger by [@​localai-bot](https://redirect.github.com/localai-bot) in [#​9518](https://redirect.github.com/mudler/LocalAI/pull/9518) - feat: add biometrics UI by [@​mudler](https://redirect.github.com/mudler) in [#​9524](https://redirect.github.com/mudler/LocalAI/pull/9524) - feat: Add Sherpa ONNX backend for ASR and TTS by [@​richiejp](https://redirect.github.com/richiejp) in [#​8523](https://redirect.github.com/mudler/LocalAI/pull/8523) - \[intel GPU support] Use latest oneapi-basekit image for Intel images to support b70 by [@​arbrick](https://redirect.github.com/arbrick) in [#​9543](https://redirect.github.com/mudler/LocalAI/pull/9543) - feat(react-ui): editorial refresh with Nord palette and polished primitives by [@​mudler](https://redirect.github.com/mudler) in [#​9550](https://redirect.github.com/mudler/LocalAI/pull/9550) - feat: surface distributed backend management errors by [@​mudler](https://redirect.github.com/mudler) in [#​9552](https://redirect.github.com/mudler/LocalAI/pull/9552) - feat(backends): add CUDA 13 + L4T arm64 CUDA 13 variants for vllm/vllm-omni/sglang by [@​mudler](https://redirect.github.com/mudler) in [#​9553](https://redirect.github.com/mudler/LocalAI/pull/9553) - feat(llama-cpp): expose split\_mode option for multi-GPU placement by [@​mudler](https://redirect.github.com/mudler) in [#​9560](https://redirect.github.com/mudler/LocalAI/pull/9560) - ci(backends): build cpu-whisperx and cpu-faster-whisper for linux/arm64 by [@​mudler](https://redirect.github.com/mudler) in [#​9573](https://redirect.github.com/mudler/LocalAI/pull/9573) - \[intel GPU support] Use latest oneapi-basekit image for Intel images to support b70 (in more places this time) by [@​arbrick](https://redirect.github.com/arbrick) in [#​9578](https://redirect.github.com/mudler/LocalAI/pull/9578) - feat: Log backend exit code by [@​richiejp](https://redirect.github.com/richiejp) in [#​9581](https://redirect.github.com/mudler/LocalAI/pull/9581) - feat(distributed): support multiple replicas of one model on the same node by [@​mudler](https://redirect.github.com/mudler) in [#​9583](https://redirect.github.com/mudler/LocalAI/pull/9583) - feat(swagger): update swagger by [@​localai-bot](https://redirect.github.com/localai-bot) in [#​9587](https://redirect.github.com/mudler/LocalAI/pull/9587) - feat: localai assistant chat modality by [@​mudler](https://redirect.github.com/mudler) in [#​9602](https://redirect.github.com/mudler/LocalAI/pull/9602) - chore: add golangci-lint with new-from-merge-base baseline by [@​richiejp](https://redirect.github.com/richiejp) in [#​9603](https://redirect.github.com/mudler/LocalAI/pull/9603) - feat(swagger): update swagger by [@​localai-bot](https://redirect.github.com/localai-bot) in [#​9607](https://redirect.github.com/mudler/LocalAI/pull/9607) - feat(vllm): expose AsyncEngineArgs via generic engine\_args YAML map by [@​richiejp](https://redirect.github.com/richiejp) in [#​9563](https://redirect.github.com/mudler/LocalAI/pull/9563) - feat(vibevoice-cpp): add purego TTS+ASR backend by [@​mudler](https://redirect.github.com/mudler) in [#​9610](https://redirect.github.com/mudler/LocalAI/pull/9610) - feat: react chat redesign by [@​mudler](https://redirect.github.com/mudler) in [#​9616](https://redirect.github.com/mudler/LocalAI/pull/9616) - feat(llama-cpp): bump to [`d775992`](https://redirect.github.com/mudler/LocalAI/commit/d775992) and adapt to spec params refactor by [@​mudler](https://redirect.github.com/mudler) in [#​9618](https://redirect.github.com/mudler/LocalAI/pull/9618) - feat(backends/python): use tempfile.gettempdir() instead of hardcoded /tmp by [@​Anai-Guo](https://redirect.github.com/Anai-Guo) in [#​9629](https://redirect.github.com/mudler/LocalAI/pull/9629) - feat(importers): whisper.cpp HF repos pick a quant + nest under whisper/models by [@​mudler](https://redirect.github.com/mudler) in [#​9630](https://redirect.github.com/mudler/LocalAI/pull/9630) - feat(branding): admin-configurable instance name, tagline, and assets by [@​mudler](https://redirect.github.com/mudler) in [#​9635](https://redirect.github.com/mudler/LocalAI/pull/9635) - feat(swagger): update swagger by [@​localai-bot](https://redirect.github.com/localai-bot) in [#​9643](https://redirect.github.com/mudler/LocalAI/pull/9643) - feat(react-ui): add multilingual (i18n) support by [@​mudler](https://redirect.github.com/mudler) in [#​9642](https://redirect.github.com/mudler/LocalAI/pull/9642) - feat(ci): allow routing apt traffic through an alternate Ubuntu mirror by [@​mudler](https://redirect.github.com/mudler) in [#​9650](https://redirect.github.com/mudler/LocalAI/pull/9650) - feat: add LocalVQE backend and audio transformations UI by [@​richiejp](https://redirect.github.com/richiejp) in [#​9640](https://redirect.github.com/mudler/LocalAI/pull/9640) - feat(swagger): update swagger by [@​localai-bot](https://redirect.github.com/localai-bot) in [#​9660](https://redirect.github.com/mudler/LocalAI/pull/9660) - feat(concurrency-groups): per-model exclusive groups for backend loading by [@​mudler](https://redirect.github.com/mudler) in [#​9662](https://redirect.github.com/mudler/LocalAI/pull/9662) - feat(api): add /v1/audio/diarization endpoint with sherpa-onnx + vibevoice.cpp by [@​mudler](https://redirect.github.com/mudler) in [#​9654](https://redirect.github.com/mudler/LocalAI/pull/9654) - feat(vllm, distributed): tensor parallel distributed workers by [@​richiejp](https://redirect.github.com/richiejp) in [#​9612](https://redirect.github.com/mudler/LocalAI/pull/9612) - feat: support word-level timestamps for faster-whisper by [@​eglia](https://redirect.github.com/eglia) in [#​9621](https://redirect.github.com/mudler/LocalAI/pull/9621) - feat(importers): add vibevoice-cpp importer for GGUF bundles by [@​localai-bot](https://redirect.github.com/localai-bot) in [#​9685](https://redirect.github.com/mudler/LocalAI/pull/9685) - feat(gallery): Speed up load times and clean gallery entries by [@​richiejp](https://redirect.github.com/richiejp) in [#​9211](https://redirect.github.com/mudler/LocalAI/pull/9211) - feat(swagger): update swagger by [@​localai-bot](https://redirect.github.com/localai-bot) in [#​9699](https://redirect.github.com/mudler/LocalAI/pull/9699) - feat(sglang): wire engine\_args, add cuda13 build, ship MTP gallery demos by [@​richiejp](https://redirect.github.com/richiejp) in [#​9686](https://redirect.github.com/mudler/LocalAI/pull/9686) - feat(api/transcription): include segments + duration + language on stream done event by [@​localai-bot](https://redirect.github.com/localai-bot) in [#​9709](https://redirect.github.com/mudler/LocalAI/pull/9709) - feat(whisper): honor client cancellation via ggml abort\_callback by [@​localai-bot](https://redirect.github.com/localai-bot) in [#​9710](https://redirect.github.com/mudler/LocalAI/pull/9710) - chore: Security hardening by [@​richiejp](https://redirect.github.com/richiejp) in [#​9719](https://redirect.github.com/mudler/LocalAI/pull/9719) - ci: phase 1-3 of GHA free tier migration (path filter, multi-arch split prep, /mnt disk relief) by [@​localai-bot](https://redirect.github.com/localai-bot) in [#​9726](https://redirect.github.com/mudler/LocalAI/pull/9726) - feat(swagger): update swagger by [@​localai-bot](https://redirect.github.com/localai-bot) in [#​9723](https://redirect.github.com/mudler/LocalAI/pull/9723) - ci: pilot per-arch split + manifest merge for faster-whisper and llama-cpp-quantization by [@​localai-bot](https://redirect.github.com/localai-bot) in [#​9727](https://redirect.github.com/mudler/LocalAI/pull/9727) - ci: finish GHA free-tier migration (per-arch fan-out, image splits, retire self-hosted, fix provenance) by [@​localai-bot](https://redirect.github.com/localai-bot) in [#​9730](https://redirect.github.com/mudler/LocalAI/pull/9730) - ci: consolidate llama-cpp-darwin into the matrix-driven Darwin flow by [@​mudler](https://redirect.github.com/mudler) in [#​9731](https://redirect.github.com/mudler/LocalAI/pull/9731) - feat(whisper-cpp): implement streaming transcription by [@​localai-bot](https://redirect.github.com/localai-bot) in [#​9751](https://redirect.github.com/mudler/LocalAI/pull/9751) ##### 🧠 Models - chore(model gallery): 🤖 add 1 new models via gallery agent by [@​localai-bot](https://redirect.github.com/localai-bot) in [#​9399](https://redirect.github.com/mudler/LocalAI/pull/9399) - chore(model gallery): 🤖 add 1 new models via gallery agent by [@​localai-bot](https://redirect.github.com/localai-bot) in [#​9400](https://redirect.github.com/mudler/LocalAI/pull/9400) - chore(model gallery): 🤖 add 1 new models via gallery agent by [@​localai-bot](https://redirect.github.com/localai-bot) in [#​9425](https://redirect.github.com/mudler/LocalAI/pull/9425) - chore(model gallery): 🤖 add 1 new models via gallery agent by [@​localai-bot](https://redirect.github.com/localai-bot) in [#​9436](https://redirect.github.com/mudler/LocalAI/pull/9436) - chore(model gallery): 🤖 add 1 new models via gallery agent by [@​localai-bot](https://redirect.github.com/localai-bot) in [#​9464](https://redirect.github.com/mudler/LocalAI/pull/9464) - chore(model gallery): 🤖 add 1 new models via gallery agent by [@​localai-bot](https://redirect.github.com/localai-bot) in [#​9481](https://redirect.github.com/mudler/LocalAI/pull/9481) - chore(model gallery): 🤖 add 1 new models via gallery agent by [@​localai-bot](https://redirect.github.com/localai-bot) in [#​9491](https://redirect.github.com/mudler/LocalAI/pull/9491) - chore(model gallery): 🤖 add 1 new models via gallery agent by [@​localai-bot](https://redirect.github.com/localai-bot) in [#​9505](https://redirect.github.com/mudler/LocalAI/pull/9505) - chore(model gallery): 🤖 add 1 new models via gallery agent by [@​localai-bot](https://redirect.github.com/localai-bot) in [#​9555](https://redirect.github.com/mudler/LocalAI/pull/9555) - chore(model gallery): 🤖 add 1 new models via gallery agent by [@​localai-bot](https://redirect.github.com/localai-bot) in [#​9558](https://redirect.github.com/mudler/LocalAI/pull/9558) - chore(model gallery): 🤖 add 1 new models via gallery agent by [@​localai-bot](https://redirect.github.com/localai-bot) in [#​9611](https://redirect.github.com/mudler/LocalAI/pull/9611) - chore(model gallery): 🤖 add 1 new models via gallery agent by [@​localai-bot](https://redirect.github.com/localai-bot) in [#​9615](https://redirect.github.com/mudler/LocalAI/pull/9615) - Add tags to qwen3-vl-reranker and Qwen3-VL-Embedding to the gallery by [@​ER-EPR](https://redirect.github.com/ER-EPR) in [#​9628](https://redirect.github.com/mudler/LocalAI/pull/9628) - chore(model gallery): add chroma1-hd diffusers model by [@​Anai-Guo](https://redirect.github.com/Anai-Guo) in [#​9646](https://redirect.github.com/mudler/LocalAI/pull/9646) - chore(model gallery): 🤖 add 1 new models via gallery agent by [@​localai-bot](https://redirect.github.com/localai-bot) in [#​9653](https://redirect.github.com/mudler/LocalAI/pull/9653) - chore(model gallery): 🤖 add 1 new models via gallery agent by [@​localai-bot](https://redirect.github.com/localai-bot) in [#​9681](https://redirect.github.com/mudler/LocalAI/pull/9681) - chore(model gallery): 🤖 add 1 new models via gallery agent by [@​localai-bot](https://redirect.github.com/localai-bot) in [#​9703](https://redirect.github.com/mudler/LocalAI/pull/9703) - chore(model gallery): 🤖 add 1 new models via gallery agent by [@​localai-bot](https://redirect.github.com/localai-bot) in [#​9720](https://redirect.github.com/mudler/LocalAI/pull/9720) ##### 📖 Documentation and examples - docs: :arrow\_up: update docs version mudler/LocalAI by [@​localai-bot](https://redirect.github.com/localai-bot) in [#​9268](https://redirect.github.com/mudler/LocalAI/pull/9268) - docs(agents): capture vllm backend lessons + runtime lib packaging by [@​mudler](https://redirect.github.com/mudler) in [#​9333](https://redirect.github.com/mudler/LocalAI/pull/9333) - chore(agents): Update the backend creation instructions to include Rust and extra tests by [@​richiejp](https://redirect.github.com/richiejp) in [#​9490](https://redirect.github.com/mudler/LocalAI/pull/9490) ##### 👒 Dependencies - chore: :arrow\_up: Update ggml-org/llama.cpp to `66c4f9ded01b29d9120255be1ed8d5835bcbb51d` by [@​localai-bot](https://redirect.github.com/localai-bot) in [#​9269](https://redirect.github.com/mudler/LocalAI/pull/9269) - chore(llama.cpp): bump to 'd12cc3d1ca6bba741cd77887ac9c9ee18c8415c7' by [@​mudler](https://redirect.github.com/mudler) in [#​9282](https://redirect.github.com/mudler/LocalAI/pull/9282) - chore: :arrow\_up: Update leejet/stable-diffusion.cpp to `e8323cabb0e4511ba18a50b1cb34cf1f87fc71ef` by [@​localai-bot](https://redirect.github.com/localai-bot) in [#​9281](https://redirect.github.com/mudler/LocalAI/pull/9281) - chore: :arrow\_up: Update ggml-org/llama.cpp to `d132f22fc92f36848f7ccf2fc9987cd0b0120825` by [@​localai-bot](https://redirect.github.com/localai-bot) in [#​9302](https://redirect.github.com/mudler/LocalAI/pull/9302) - chore: :arrow\_up: Update PABannier/sam3.cpp to `01832ef85fcc8eb6488f1d01cd247f07e96ff5a9` by [@​localai-bot](https://redirect.github.com/localai-bot) in [#​9311](https://redirect.github.com/mudler/LocalAI/pull/9311) - chore: :arrow\_up: Update ggml-org/llama.cpp to `e62fa13c2497b2cd1958cb496e9489e86bbd5182` by [@​localai-bot](https://redirect.github.com/localai-bot) in [#​9312](https://redirect.github.com/mudler/LocalAI/pull/9312) - chore(model-gallery): :arrow\_up: update checksum by [@​localai-bot](https://redirect.github.com/localai-bot) in [#​9321](https://redirect.github.com/mudler/LocalAI/pull/9321) - chore: :arrow\_up: Update leejet/stable-diffusion.cpp to `6b675a5ede9b0edf0a0f44191e8b79d7ef27615a` by [@​localai-bot](https://redirect.github.com/localai-bot) in [#​9320](https://redirect.github.com/mudler/LocalAI/pull/9320) - chore: :arrow\_up: Update ggml-org/llama.cpp to `ff5ef8278615a2462b79b50abdf3cc95cfb31c6f` by [@​localai-bot](https://redirect.github.com/localai-bot) in [#​9319](https://redirect.github.com/mudler/LocalAI/pull/9319) - chore: :arrow\_up: Update ggml-org/llama.cpp to `1e9d771e2c2f1113a5ebdd0dc15bafe57dce64be` by [@​localai-bot](https://redirect.github.com/localai-bot) in [#​9330](https://redirect.github.com/mudler/LocalAI/pull/9330) - chore(deps): bump softprops/action-gh-release from 2 to 3 by [@​dependabot](https://redirect.github.com/dependabot)\[bot] in [#​9336](https://redirect.github.com/mudler/LocalAI/pull/9336) - chore(deps): bump actions/upload-pages-artifact from 4 to 5 by [@​dependabot](https://redirect.github.com/dependabot)\[bot] in [#​9337](https://redirect.github.com/mudler/LocalAI/pull/9337) - chore(deps): bump github.com/testcontainers/testcontainers-go from 0.41.0 to 0.42.0 by [@​dependabot](https://redirect.github.com/dependabot)\[bot] in [#​9338](https://redirect.github.com/mudler/LocalAI/pull/9338) - chore(model-gallery): :arrow\_up: update checksum by [@​localai-bot](https://redirect.github.com/localai-bot) in [#​9346](https://redirect.github.com/mudler/LocalAI/pull/9346) - chore(deps): bump sentence-transformers from 5.2.3 to 5.4.0 in /backend/python/transformers by [@​dependabot](https://redirect.github.com/dependabot)\[bot] in [#​9342](https://redirect.github.com/mudler/LocalAI/pull/9342) - chore: :arrow\_up: Update ggml-org/llama.cpp to `e97492369888f5311e4d1f3beb325a36bbed70e9` by [@​localai-bot](https://redirect.github.com/localai-bot) in [#​9347](https://redirect.github.com/mudler/LocalAI/pull/9347) - chore: :arrow\_up: Update ikawrakow/ik\_llama.cpp to `55d3c05bf7b377deaa5dc84d255d9740a345a206` by [@​localai-bot](https://redirect.github.com/localai-bot) in [#​9348](https://redirect.github.com/mudler/LocalAI/pull/9348) - chore(deps): bump github.com/google/go-containerregistry from 0.21.3 to 0.21.5 by [@​dependabot](https://redirect.github.com/dependabot)\[bot] in [#​9343](https://redirect.github.com/mudler/LocalAI/pull/9343) - chore(deps): bump github.com/testcontainers/testcontainers-go/modules/nats from 0.41.0 to 0.42.0 by [@​dependabot](https://redirect.github.com/dependabot)\[bot] in [#​9341](https://redirect.github.com/mudler/LocalAI/pull/9341) - chore(deps): bump github.com/swaggo/echo-swagger from 1.4.1 to 1.5.2 by [@​dependabot](https://redirect.github.com/dependabot)\[bot] in [#​9344](https://redirect.github.com/mudler/LocalAI/pull/9344) - chore(deps): bump github.com/charmbracelet/glamour from 0.10.0 to 1.0.0 by [@​dependabot](https://redirect.github.com/dependabot)\[bot] in [#​9340](https://redirect.github.com/mudler/LocalAI/pull/9340) - chore: :arrow\_up: Update ggml-org/llama.cpp to `fae3a28070fe4026f87bd6a544aba1b2d1896566` by [@​localai-bot](https://redirect.github.com/localai-bot) in [#​9357](https://redirect.github.com/mudler/LocalAI/pull/9357) - chore(model-gallery): :arrow\_up: update checksum by [@​localai-bot](https://redirect.github.com/localai-bot) in [#​9358](https://redirect.github.com/mudler/LocalAI/pull/9358) - chore(model-gallery): :arrow\_up: update checksum by [@​localai-bot](https://redirect.github.com/localai-bot) in [#​9369](https://redirect.github.com/mudler/LocalAI/pull/9369) - chore: :arrow\_up: Update ggml-org/llama.cpp to `b3d758750a268bf93f084ccfa3060fb9a203192a` by [@​localai-bot](https://redirect.github.com/localai-bot) in [#​9370](https://redirect.github.com/mudler/LocalAI/pull/9370) - chore: :arrow\_up: Update ikawrakow/ik\_llama.cpp to `1163af96cf6bb4a4b819f998f84c153a49768b99` by [@​localai-bot](https://redirect.github.com/localai-bot) in [#​9368](https://redirect.github.com/mudler/LocalAI/pull/9368) - chore(deps): bump the npm\_and\_yarn group across 1 directory with 6 updates by [@​dependabot](https://redirect.github.com/dependabot </details> --- ### Configuration 📅 **Schedule**: (UTC) - Branch creation - At any time (no schedule defined) - Automerge - At any time (no schedule defined) 🚦 **Automerge**: Enabled. ♻ **Rebasing**: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox. 🔕 **Ignore**: Close this PR and you won't be reminded about this update again. --- - [ ] <!-- rebase-check -->If you want to rebase/retry this PR, check this box --- This PR has been generated by [Renovate Bot](https://redirect.github.com/renovatebot/renovate). <!--renovate-debug:eyJjcmVhdGVkSW5WZXIiOiI0My4xMzAuMSIsInVwZGF0ZWRJblZlciI6IjQzLjEzMC4xIiwidGFyZ2V0QnJhbmNoIjoibWFzdGVyIiwibGFiZWxzIjpbImFwcC9sb2NhbC1haSIsImF1dG9tZXJnZSIsInJlbm92YXRlL2NvbnRhaW5lciIsInR5cGUvbWlub3IiXX0=-->
This commit is contained in:
TrueCharts Bot
@@ -9,7 +9,7 @@ annotations:
|
||||
trueforge.org/min_helm_version: "3.14"
|
||||
trueforge.org/train: stable
|
||||
apiVersion: v2
|
||||
appVersion: 4.1.3
|
||||
appVersion: 4.2.0
|
||||
dependencies:
|
||||
- name: common
|
||||
version: 29.3.4
|
||||
@@ -36,5 +36,5 @@ sources:
|
||||
- https://github.com/trueforge-org/truecharts/tree/master/charts/stable/local-ai
|
||||
- https://hub.docker.com/r/localai/localai
|
||||
type: application
|
||||
version: 18.4.0
|
||||
version: 18.5.0
|
||||
|
||||
|
||||
@@ -2,7 +2,7 @@
|
||||
image:
|
||||
repository: docker.io/localai/localai
|
||||
pullPolicy: IfNotPresent
|
||||
tag: v4.1.3@sha256:a6af99e17a73a92caa134e70ae84492cc47b67645c1676268a7522ad14f4c09d
|
||||
tag: v4.2.0@sha256:70c670f871bebbbf13b9274c76657e80d204df1ebebb57d565ee2959becee166
|
||||
ffmpegImage:
|
||||
repository: docker.io/localai/localai
|
||||
pullPolicy: IfNotPresent
|
||||
|
||||
Reference in New Issue
Block a user