Skip to content

Commit cfbff89

Browse files
kdamaszkxinhe3
authored andcommitted
[SW-232491] Fix collective functions from vLLM (#250)
1 parent abeaad9 commit cfbff89

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

neural_compressor/torch/algorithms/fp8_quant/_core/vllm_functions.py

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -23,10 +23,10 @@
2323
tensor_model_parallel_all_gather = None
2424
tensor_model_parallel_all_reduce = None
2525

26-
def get_vllm_row_parallel_collective_func():
26+
def get_vllm_column_parallel_collective_func():
2727
assert tensor_model_parallel_all_gather is not None, "Couldn't import vllm function tensor_model_parallel_all_gather"
2828
return tensor_model_parallel_all_gather
2929

30-
def get_vllm_column_parallel_collective_func():
30+
def get_vllm_row_parallel_collective_func():
3131
assert tensor_model_parallel_all_reduce is not None, "Couldn't import vllm function tensor_model_parallel_all_reduce"
3232
return tensor_model_parallel_all_reduce

0 commit comments

Comments
 (0)