Machine information: R4900 G6
Network card information: NIC-BCM957414-F-B-25Gb-2P
Operating system information: CentOS
Linux source package version: 1.10.3-230.0.132.0
To enable RDMA function on Broadcom NICs, install the bnxt_en and bnxt_re drivers from the Linux source package.
This document explains the specific method for installing these drivers.
The required yum for installation can be obtained from the image itself. It is recommended not to use additional sources.
gcc kernel-devel make rdma-core-devel automake libtool libibverbs-utils
#yum install -y gcc kernel-devel make rdma-core-devel automake libtool libibverbs-utils
Source package driver installation steps:
1. Install bnxt_en
# cd /root
# tar xzvf netxtreme-bnxt_en-1.10.3-230.0.132.0.tar.gz
# tar xzvf libbnxt_re-230.0.132.0.tar.gz
# cd netxtreme-bnxt_en-1.10.3-230.0.132.0
# make&&make install
# modprobe -r bnxt_en && modprobe bnxt_en
2. Enter netxtreme-bnxt_en-1.10.3-230.0.132.0 under bnxt_re-230.0.132.0 and continue compiling bnxt_re
# cd bnxt_re-230.0.132.0/
# make&&make install
# modinfo bnxt_re
3. Enter libbnxt_re-230.0.132.0 for bnxt_re driver load and configuration
# cd /root/libbnxt_re-230.0.132.0
# ls
# sh autogen.sh
# ./configure --syscOnfdir=/etc
# make
# make install all
# cd /etc/libibverbs.d/
# vi /etc/ld.so.conf
Add a line /usr/local/lib save
# ldconfig -v
# modprobe -r bnxt_re && modprobe bnxt_re
# cd /root/libbnxt_re-230.0.132.0/src/.libs/
# cp libbnxt_re-rdmav22.so /usr/lib64/libibverbs/
4. Verify successful installation via the following command
#modinfo
#ibv_devices
#ibv_devinfo