Skip to content

Commit a68db12

Browse files
authored
Fix quickstart multiple devices (#3698)
Readme command not accommodating multiple devices in /dev/dri. Alternative is to add: `$(for g in $(echo 992 992 998 | sort -u); do echo --group-add=$g; done)` But that would look less elegant in readme. Ticket:CVS-174480
1 parent 8f243cf commit a68db12

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

docs/llm/quickstart.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -19,7 +19,7 @@ You can use another model from [OpenVINO organization on HuggingFace](https://hu
1919

2020
```bash
2121
mkdir models
22-
docker run --user $(id -u):$(id -g) -d --device /dev/dri --group-add=$(stat -c "%g" /dev/dri/render*) --rm -p 8000:8000 -v $(pwd)/models:/models:rw openvino/model_server:latest-gpu --source_model OpenVINO/Phi-3.5-mini-instruct-int4-ov --model_repository_path models --task text_generation --rest_port 8000 --target_device GPU --cache_size 2
22+
docker run --user $(id -u):$(id -g) -d --device /dev/dri --group-add=$(stat -c "%g" /dev/dri/render* | head -n 1) --rm -p 8000:8000 -v $(pwd)/models:/models:rw openvino/model_server:latest-gpu --source_model OpenVINO/Phi-3.5-mini-instruct-int4-ov --model_repository_path models --task text_generation --rest_port 8000 --target_device GPU --cache_size 2
2323
```
2424
:::
2525

0 commit comments

Comments
 (0)