Skip to content

Commit 927f83a

Browse files
committed
Add Func: npugraph_batch_size auto-adjust to different model
1 parent 16413eb commit 927f83a

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

tests/singlecard/test_dynamic_npugraph_batchsize.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -17,8 +17,8 @@
1717
import pytest
1818
import torch
1919

20-
from vllm import LLM, SamplingParams
2120
from torch_npu.op_plugin.atb._atb_ops import _register_atb_extensions
21+
from vllm import LLM, SamplingParams
2222

2323
_register_atb_extensions()
2424
torch.cuda.CUDAGraph = torch.npu.NPUGraph

0 commit comments

Comments
 (0)