We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
1 parent ee81366 commit 5b094a8Copy full SHA for 5b094a8
colossalai/inference/README.md
@@ -62,7 +62,7 @@ engine = InferenceEngine(model, tokenizer, inference_config, verbose=True)
62
63
# Step 4: try inference
64
prompts = ['Who is the best player in the history of NBA?']
65
-response = engine.generate(prompts)
+response = engine.generate(prompts=prompts)
66
pprint(response)
67
```
68
0 commit comments