Is it applicable to the L20 card?

[jiaozenghui]

[AddyLaddy]

It looks like your CUDA toolkit is not installed correctly.
I see it says nvlink not found

[jiaozenghui]

It looks like your CUDA toolkit is not installed correctly. I see it says nvlink not found

Yes my CUDA tookit does not have nvlink component, does nccl-tests must require nvlink to run?

[sjeaugey]

nvlink is the NVIDIA linker program, which should come as part of the CUDA compiler. You need it to link CUDA code. It should be in /usr/local/cuda/bin/nvlink unless your CUDA installation is broken. If so, you should reinstall CUDA.

Note, it has nothing to do with NVLink, the hardware connecting GPUs for high-bandwidth communication.

[jiaozenghui]

nvlink is the NVIDIA linker program, which should come as part of the CUDA compiler. You need it to link CUDA code. It should be in /usr/local/cuda/bin/nvlink unless your CUDA installation is broken. If so, you should reinstall CUDA.

Note, it has nothing to do with NVLink, the hardware connecting GPUs for high-bandwidth communication.

The communication between NVIDIA L20 cards does not support NVLink and mainly relies on PCIe Gen4 x16 to achieve multi card communication within nodes. High speed interconnection between nodes is achieved through RDMA (InfiniBand/RoCE)+NCCL.