Repository navigation
Immich 2.5.2 Machine Learning Broken (OpenVINO / Intel) #25830
Description
I have searched the existing issues, both open and closed, to make sure this is not a duplicate report.
- Yes
The bug
Dear all,
I would like to report an issue that I noticed very recently (possibly less than a week ago), likely following the update to latest release of Immich (docker).
My Immich instance is configured to use Intel integrated GPU (Jasper Lake) via OpenVINO and has been working like a charm for several months flawlessly to accelerate facial recognition.
However, since recent update, facial recognition does not work anymore. I checked the log of the immich_machine_learning and I found error linked to OpenVINO.
I'm looking for other experiences and feedbacks regarding possibly similar issues.
The OS that Immich Server is running on
Debian 12
Version of Immich Server
v.2.5.2
Version of Immich Mobile App
v2.5.2
Platform with the issue
- Server
- Web
- Mobile
Device make and model
No response
Your docker-compose.yml content
services:
immich-server:
container_name: immich_server
image: ghcr.io/immich-app/immich-server:release
# extends:
# file: hwaccel.transcoding.yml
# service: cpu # set to one of [nvenc, quicksync, rkmpp, vaapi, vaapi-wsl] for accelerated
shm_size: '512m'
command: ["start.sh", "immich", "--hostname", "0.0.0.0"]
volumes:
- ${UPLOAD_LOCATION}:/usr/src/app/upload
env_file:
- .env
ports:
- "${IMMICH_PORT}:2283"
devices:
- /dev/dri:/dev/dri
depends_on:
- redis
- database
restart: always
networks:
- big_bear_immich_network
immich-microservices:
container_name: immich_microservices
image: ghcr.io/immich-app/immich-server:release
shm_size: '512m'
devices:
- /dev/dri:/dev/dri
env_file:
- .env
depends_on:
- redis
- database
restart: always
networks:
- big_bear_immich_network
immich-machine-learning:
container_name: immich_machine_learning
image: ghcr.io/immich-app/immich-machine-learning:release-openvino
extends:
file: hwaccel.ml.yml
service: openvino
volumes:
- /DATA/AppData/big-bear-immich/model-cache:/cache
environment:
- DB_HOSTNAME=immich_postgres
- DB_USERNAME=
- DB_PASSWORD=
- DB_DATABASE_NAME=immich
- REDIS_HOSTNAME=immich_redis
restart: always
networks:
- big_bear_immich_network
redis:
container_name: immich_redis
image: redis:6.2-alpine
restart: always
networks:
- big_bear_immich_network
database:
container_name: immich_postgres
image: ghcr.io/immich-app/postgres:14-vectorchord0.4.3-pgvectors0.2.0
env_file:
- .env
volumes:
- /DATA/AppData/big-bear-immich/pgdata:/var/lib/postgresql/data
restart: always
networks:
- big_bear_immich_network
networks:
big_bear_immich_network:
name: big-bear-immich_big_bear_immich_network
external: trueYour .env content
N/AReproduction steps
I just noticed that no faces were recognized on newly uploaded photos
Relevant log output
026-02-02 15:16:07.894403429 [E:onnxruntime:, inference_session.cc:2544 operator()] Exception during initialization: /onnxruntime/onnxruntime/core/providers/openvino/backends/basic_backend.cc:135 onnxruntime::openvino_ep::BasicBackend::BasicBackend(std::unique_ptr<onnx::ModelProto>&, onnxruntime::openvino_ep::SessionContext&, const onnxruntime::openvino_ep::SubGraphContext&, onnxruntime::openvino_ep::SharedContext&, onnxruntime::openvino_ep::ptr_stream_t&) /onnxruntime/onnxruntime/core/providers/openvino/ov_interface.cc:24 auto onnxruntime::openvino_ep::OvExceptionBoundary(Func&&, std::format_string<_Args ...>&&, Args&& ...) [with Func = OVCore::CompileModel(std::shared_ptr<const ov::Model>&, std::string&, ov::AnyMap&, bool, const std::string&)::<lambda()>; Args = {const std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >&}; std::format_string<_Args ...> = std::basic_format_string<char, const std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >&>] [OpenVINO-EP] Exception while Loading Network for graph OpenVINOExecutionProvider_OpenVINO-EP-subgraph_1_0: Exception from src/inference/src/cpp/core.cpp:109:
Exception from src/inference/src/dev/plugin.cpp:53:
Exception from src/plugins/intel_gpu/src/runtime/ocl/ocl_engine.cpp:205:
[GPU] clCreateSubBuffer, error code: -30 CL_INVALID_VALUEAdditional information
Configurations for hardware-accelerated machine learning
If using Unraid or another platform that doesn't allow multiple Compose files,
you can inline the config for a backend by copying its contents
into the immich-machine-learning service in the docker-compose.yml file.
See https://immich.app/docs/features/ml-hardware-acceleration for info on usage.
services:
armnn:
devices:
- /dev/mali0:/dev/mali0
volumes:
- /lib/firmware/mali_csffw.bin:/lib/firmware/mali_csffw.bin:ro # Mali firmware for your chipset (not always required depending on the driver)
- /usr/lib/libmali.so:/usr/lib/libmali.so:ro # Mali driver for your chipset (always required)
rknn:
security_opt:
- systempaths=unconfined
- apparmor=unconfined
devices:
- /dev/dri:/dev/dri
cpu: {}
cuda:
deploy:
resources:
reservations:
devices:
- driver: nvidia
count: 1
capabilities:
- gpu
rocm:
group_add:
- video
devices:
- /dev/dri:/dev/dri
- /dev/kfd:/dev/kfd
openvino:
device_cgroup_rules:
- 'c 189:* rmw'
devices:
- /dev/dri:/dev/dri
volumes:
- /dev/bus/usb:/dev/bus/usb
openvino-wsl:
devices:
- /dev/dri:/dev/dri
- /dev/dxg:/dev/dxg
volumes:
- /dev/bus/usb:/dev/bus/usb
- /usr/lib/wsl:/usr/lib/wsl
Metadata
Metadata
Assignees
Labels
Type
Projects
- StatusShow more project fieldsDone
Activity
simplicite72 commentedon Feb 2, 2026
I confirm this is an issue linked to the a recent relase of Immich.
I just tried with a previous version of immich_machine_learning (2.4.1 Openvino) with Immich-server 2.5.2
🟢 Face detection + recognition works now well with GPU (machine accelerated) immediately when pictures are uploaded
🟢 Recognised faces (persons) appear on Immich Web
immich-machine-learning: container_name: immich_machine_learning image: ghcr.io/immich-app/immich-machine-learning:v2.4.1-openvino extends: file: hwaccel.ml.yml service: openvinoRDshift commentedon Feb 4, 2026
I am seeing similar behavior on unraid with the xe kernel driver manually enabled as well, except 2.4.1 also fails for me for GPU due to xe. Intel Arc A310.
Retested on both v2.5.3-all (with -openvino) and 2.5.3+2.4.1ML-openvino.
joaquimBS commentedon Feb 5, 2026
Same here, 2.5.x broke ML capabilities. I am running 2.4.1 and now it works again. Synology DS423+.
bleomycin commentedon Feb 6, 2026
Can also confirm the breaking change here. Thought I was losing my mind for a bit.
gianmarcos96 commentedon Feb 6, 2026
I have updated to 2.5.5 and still have the server error when i search something. My log is different, may someone can help me?
Nest] 25 - 02/06/2026, 8:16:39 PM WARN [Api:MachineLearningRepository~gfcq7p7w] Machine learning request to "http://immich-machine-learning:3003" failed: fetch failed [Nest] 25 - 02/06/2026, 8:16:39 PM ERROR [Api:ErrorInterceptor~gfcq7p7w] Unknown error: Error: Machine learning request '{"clip":{"textual":{"modelName":"ViT-L-16-SigLIP-256__webli","options":{"language":"it-null"}}}}' failed for all URLs Error: Machine learning request '{"clip":{"textual":{"modelName":"ViT-L-16-SigLIP-256__webli","options":{"language":"it-null"}}}}' failed for all URLs at MachineLearningRepository.predict (/usr/src/app/server/dist/repositories/machine-learning.repository.js:117:15) at process.processTicksAndRejections (node:internal/process/task_queues:103:5) at async MachineLearningRepository.encodeText (/usr/src/app/server/dist/repositories/machine-learning.repository.js:140:26) at async SearchService.searchSmart (/usr/src/app/server/dist/services/search.service.js:94:29)mikesnav commentedon Feb 9, 2026
Also experiencing this - was fine on 2.4.1 and broke when I moved up to 2.5.x
Snuupy commentedon Feb 10, 2026
same but on rocm/gfx 9.00 / 5825U
ERROR [Api:ErrorInterceptor~iwgbq60k] Unknown error: Error: Machine learning request '{"clip":{"textual":{"modelName":"ViT-B-32__openai","options":{"language":"en-US"}}}}' failed for all URLsedit: this is the issue #24734
gianmarcos96 commentedon Feb 10, 2026
Now I have updated to 2.5.6 and then i ran the process of machine learning for smart search. Now the search is working fine. I will check better at the end of the process
Update: after the process of smart search, now it works fine for me. 2.5.6 solved my issue
MisterBolt commentedon Feb 12, 2026
I'm starting my adventure with Immich and i have the same error on proxmox with VM - Ubuntu 24.04.3 LTS.
Tested Immich ML - 2.4.1/2.5.5/2.5.6
I have Gemini Lake processor with legacy support for GPU drivers installed from the instruction here: https://github.com/intel/compute-runtime/releases/tag/24.35.30872.22
gmcinalli commentedon Feb 16, 2026
Running v2.5.6, facial recognition still broken with OpenVINO.
Tryfos commentedon Feb 22, 2026
Ok, this is VERY brutal, especially for newcomers to Immich :) With a humble N5095 here I've been struggling with all this for the past 3 days. Jasper Lake quirks (the forgotten CPU line by Intel), low power stuff for HEVC, VP9 etc., legacy opencl or not (it is legacy!), kernel parameters (guc), vainfo, clinfo, Proxmox LXC passthrough and a WHOLE lot of other things. Made and nuked almost 10 CTs in Proxmox :). Also: Trixie does not have opencl in its stable repositories. Changed to SID (in production Proxmox!), just to download the legacy opencl....In the end clinfo was perfect in my LXC container, gpu passthrough ok, hardware transcoding worked just fine. One thing was constantly failing: Hardware ML (exception during initialization, exception in ASGI application, exceptions in general and a whole lot of other extremely low-level debugging errors).
Chatgpt was screaming and insisting, N5095 cannot do ML reliably, give up! As soon as I read this thread, I said to myself "one last hail Mary" and I sincerely give up. I changed to ML image 2.4.1. as initially suggested above and LO AND BEHOLD, HA ML is magically working with N5095!!! All this time it's just a buggy 2.5.6 (or earlier) ML image!!! Extremely exhausting for a newcomer to deal with this, because it's the last thing to calculate...
(Of course I'm going to go ahead and try all the subsequent image versions until ML doesn't work again :)
Devs keep up the GREAT work you're doing, but for the love of God: "What has changed since ML 2.4.1 image"!!!!???? :)))))))
Edit: Proxmox 9 with Debian 13 LXC containers.
Edit2: Now I have to sanity check if (legacy) opencl is indeed needed to run HA ML or not or if it was the image all along....
Edit3: It's not needed, oh my God.....:)
Edit4: Tested with 2.5.5, 2.5.3 and 2.5.0, HA ML fails in all of them. So last known working HA ML image is indeed 2.4.1. The question now is how long we're going to be able to have different Immich and ML image versions without problems...
58 remaining items
Powerbless commentedon Jul 29, 2026
Me too. I activate my GPU acceleration today on a Intel n305 with GPU passtrough to my immich and jellyfin VM and have no issues. Uploaded 100 Pictures from a face Sample package and the GPU run on 100% and No Errors in immich.
Tryfos commentedon Jul 29, 2026
The bug definitely exists and is hardware-specific to Gen11 Jasper Lake cpus, so please don't confuse people. It has now been verified to be upstream in openvino and supposedly has been resolved in openvino nightly.
See last comment here #27637
And resolution here openvinotoolkit/openvino#36831
So we just have to wait for the stable openvino release which will carry the fix, and then for immich to also upgrade to latest openvino for a complete solution.
N7-BADA commentedon Jul 29, 2026
Don't forget the arc a380! Suffers the same issue
hornofabraxas commentedon Jul 29, 2026
It seems to be specific to the Large model, so if you have this issue today and want to work around it instead of waiting, you can change your facial recognition model to (for example) "buffalo_s". However:
I got tired of waiting so I made this change and my i3-n305 is now working properly and has blown through ~10k images in ~10 minutes. This workaround won't be for everyone considering the reset requirement and implications of a smaller model.
phantasyleo commentedon Aug 18, 2026
I've got the same problem with Immich 3.1.0 + Immich Machine Learning 3.1.0. The CPU in my NAS (ZSpace Z4S) is an Intel Celeron N5105. I have to use Immich 3.1.0 + Immich Machine Learning 2.4.1 to avoid the face recognition problem for now. I wonder when this problem will be fixed. PLEASE!
fonz-zz commentedon Sep 11, 2026
Any chance it got fixed in v3.2.0? I can see the bug was closed on openvino side, but not sure if it got propagated to the latest immich
ChristianCiach commentedon Sep 11, 2026
No. Immich doesn't use openvino directly, but uses onnxruntime-openvino which bundles an older version of openvino. So first there needs to be a new release of onnxruntime-openvino that will hopefully bundle a recent version of openvino and then Immich needs to upgrade to the new version of onnxruntime-openvino. I wouldn't hold my breath.
phantasyleo commentedon Sep 11, 2026
So this problem has not been solved yet, right? HAS to use the Immich 3.1.0 + Immich ml 2.4.1😓
mertalev commentedon Sep 28, 2026
This should be fixed as of #31750.
phantasyleo commentedon Sep 29, 2026
I've tried immich_server 3.2.4+immich_machine_learning 3.2.4-openvino, but just find that the problem is still there. NOT BE FIXED! HAVE TO turn back to immich_server 3.2.4+immich_machine_learning v2.4.1-openvino again. Only in this way can the facial-recognition work well. Please check the problem again, thank you!
dvarnes commentedon Sep 29, 2026
No, this is not the case at all .. the fix that @mertalev posted has been merged to the main code base, but has not yet been released. That will happen over the next few weeks.
When version 3.3 is released then test again.
phantasyleo commentedon Sep 29, 2026
OK,I got it, thank you:)
RDshift commentedon Oct 8, 2026
I have verified functionality is restored on 3.3 on OpenVINO and cross-tested on CUDA. There are a few things to do to recover, of course - particularly don't forget to set the new ML variable to v2, and mind your queues and concurrency.
If you have a large backlog, I've just built a solution to address mine and do significant rework of my collection, particularly to benefit from the recent improvements, models, and thumbnails. Happy to share it.
This will let you offload to something like a gaming machine to chew through your queue faster. I will post a repo for the script pack soon, or you can DM me for it. Built for Win/WSL/CUDA, but it's tiny and ought to be easy to convert with your AI if you are on different technologies. No support will be provided.
Cheers, Team Immich! And I love all the other new improvements.
phantasyleo commentedon Oct 8, 2026
Very HAPPY to see the bug has finally been fixed on version 3.3.0! The facial-recognition part works again. Just do nothing but wait. Thank you very much, Team Immich! By the way, I also love the other news, especially “Birthday memories”.