Skip to content

Commit 15777d5

Browse files
committed
\Used assitant advice to fix completion
Signed-off-by: DilreetRaju <[email protected]>
1 parent a7ba2d5 commit 15777d5

File tree

1 file changed

+9
-9
lines changed

1 file changed

+9
-9
lines changed

docs/backends/vllm/speculative_decoding.md

Lines changed: 9 additions & 9 deletions
Original file line numberDiff line numberDiff line change
@@ -81,15 +81,15 @@ Once the weights finish downloading and serving begins, you’ll be ready to sen
8181
To verify your setup, try sending a simple prompt to your model:
8282

8383
```bash
84-
curl http://localhost:8000/v1/completions \
85-
-H "Content-Type: application/json" \
86-
-d '{
87-
"model": "meta-llama/Meta-Llama-3.1-8B-Instruct",
88-
"messages": [
89-
{"role": "user", "content": "Write a poem about why Sakura trees are beautiful."}
90-
],
91-
"max_tokens": 250
92-
}'
84+
curl http://localhost:8000/v1/chat/completions \
85+
-H "Content-Type: application/json" \
86+
-d '{
87+
"model": "meta-llama/Meta-Llama-3.1-8B-Instruct",
88+
"messages": [
89+
{"role": "user", "content": "Write a poem about why Sakura trees are beautiful."}
90+
],
91+
"max_tokens": 250
92+
}'
9393
```
9494

9595
### Example Output

0 commit comments

Comments
 (0)