The ACOS supports RDMA through SR-IOV. To enable RDMA for the cluster, you also need to perform the following configuration on the ESXi host. Otherwise, skip the configuration steps below.
Precaution
Before configuration, specify one Mellanox NIC as the RDMA NIC. You can run the esxcfg-nics -l command to view the port information of all NICs, as shown below, to identify the network port of the Mellanox NIC that will serve as the RDMA NIC, and record the name (such as vminc1) and the PCI ID (such as 0000:18:00.0) of the network port to be used on that NIC.
When you need to use multiple network ports, make sure that the recorded network ports belong to the same RDMA NIC. The PCI IDs of different network ports on the same NIC differ only in the last digit, with the rest being the same.
# esxcfg-nics -l
Name PCI Driver Link Speed Duplex MAC Address MTU Description
vmnic1 0000:18:00.0 nmlx5_core Up 25000Mbps Full 0c:42:a1:24:ad:1e 1500 Mellanox Technologies ConnectX-4 Lx EN NIC; OCP; 25GbE; dual-port SFP28; (MCX4421A-ACQ)
vmnic2 0000:18:00.1 nmlx5_core Up 25000Mbps Full 0c:42:a1:24:ad:1f 1500 Mellanox Technologies ConnectX-4 Lx EN NIC; OCP; 25GbE; dual-port SFP28; (MCX4421A-ACQ)
vmnic3 0000:5e:00.0 igbn Up 1000Mbps Full b4:96:91:93:a6:d8 1500 Intel Corporation I350 Gigabit Network Connection
vmnic4 0000:5e:00.1 igbn Down 0Mbps Half b4:96:91:93:a6:d9 1500 Intel Corporation I350 Gigabit Network Connection