Skip to content

Commit 52dfa94

Browse files
committed
Replace --model option in the launch command with a positional argument
1 parent bf919e9 commit 52dfa94

File tree

1 file changed

+1
-2
lines changed

1 file changed

+1
-2
lines changed

vec_inf/client/_client_vars.py

Lines changed: 1 addition & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -222,8 +222,7 @@ class SlurmScriptTemplate(TypedDict):
222222
' && mv temp.json "$json_path"',
223223
],
224224
"launch_cmd": [
225-
"vllm serve \\",
226-
" --model {model_weights_path} \\",
225+
"vllm serve {model_weights_path} \\",
227226
" --served-model-name {model_name} \\",
228227
' --host "0.0.0.0" \\',
229228
" --port $vllm_port_number \\",

0 commit comments

Comments
 (0)