Red Hat Enteprise Linux/CENTOS 6 with Mellanox network interface stopped working after reboot: mlx4_en.ko needs unknown symbol

In a upgrade, after installing the kernel-2.6.32-696.20.1.el6.x86_64 on a Red Hat 6 it showed the following message

mlx4_en.ko needs unknown symbol mlx4_SET_PORT_BEACON

The network interface were not working after the reboot

4 network interfaces that stopped working – eth0, eth1, eth2, eth3

They use the Mellanox driver

root@linux:~ # ethtool -i eth0
driver: mlx4_en
version: 4.1-1.0.2 (27 Jun 2017)
firmware-version: 2.35.5100
bus-info: 0000:04:00.0
supports-statistics: yes
supports-test: yes
supports-eeprom-access: no
supports-register-dump: no
supports-priv-flags: yes

root@linux:~ # modinfo mlx4_en
filename: /lib/modules/2.6.32-573.22.1.el6.x86_64/weak-updates/mlnx-en/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko
version: 2.3-2.0.1 (Dec 7 2014)
license: Dual BSD/GPL
description: Mellanox ConnectX HCA Ethernet driver
author: Liran Liss, Yevgeny Petrilin
srcversion: 86DD1A5FE5CF17268AFBB0D
depends: mlx4_core,compat,ptp
vermagic: 2.6.32-504.el6.x86_64 SMP mod_unload modversions
parm: inline_thold:threshold for using inline data (uint)
parm: udp_rss:Enable RSS for incoming UDP traffic (uint)
parm: num_lro:Dummy module parameter to prevent loading issues (uint)
parm: pfctx:Priority based Flow Control policy on TX[7:0]. Per priority bit mask (uint)
parm: pfcrx:Priority based Flow Control policy on RX[7:0]. Per priority bit mask (uint)

You need to install the Mellanox driver in order for the network interfaces to work

The server is a HPE Proliant DL380 Gen9. Download both files to install and copy them to the server. If necessary, boot the old working kernel

HPE Mellanox RoCE (RDMA over Converged Ethernet) Driver for Red Hat Enterprise Linux 6 Update 6 (x86_64)

HPE Mellanox RoCE (RDMA over Converged Ethernet) Driver for Red Hat Enterprise Linux 6 Update 7 (x86_64)

HPE Mellanox RoCE (RDMA over Converged Ethernet) Driver for Red Hat Enterprise Linux 6 Update 8 (x86_64)

HPE Mellanox RoCE (RDMA over Converged Ethernet) Driver for Red Hat Enterprise Linux 6 Update 9 (x86_64)

Copied both files to /tmp

kmod-mlnx-ofa_kernel-4.1-OFED.4.1.1.0.2.1.gc22af88.rhel6u9.x86_64.rpm
mlnx-ofa_kernel-4.1-OFED.4.1.1.0.2.1.gc22af88.rhel6u9.x86_64.rpm

In my case I had to remove the following packages and dependencies

# yum remove librdmacm libibverbs
# yum remove mlnx-en-utils kmod-mlnx-en

Then install both packages

root@linux:/tmp # rpm -ivh mlnx-ofa_kernel-4.1-OFED.4.1.1.0.2.1.gc22af88.rhel6u9.x86_64.rpm kmod-mlnx-ofa_kernel-4.1-OFED.4.1.1.0.2.1.gc22af88.rhel6u9.x86_64.rpm
warning: mlnx-ofa_kernel-4.1-OFED.4.1.1.0.2.1.gc22af88.rhel6u9.x86_64.rpm: Header V3 RSA/SHA256 Signature, key ID 26c2b797: NOKEY
Preparing… ########################################### [100%]
1:mlnx-ofa_kernel ########################################### [ 50%]
Configured /etc/security/limits.conf
2:kmod-mlnx-ofa_kernel ########################################### [100%]
WARNING: /lib/modules/2.6.32-573.18.1.el6.x86_64/kernel/drivers/net/mlx4/mlx4_en.ko needs unknown symbol mlx4_test_interrupts
WARNING: /lib/modules/2.6.32-573.18.1.el6.x86_64/kernel/drivers/net/mlx4/mlx4_en.ko needs unknown symbol mlx4_set_stats_bitmap
WARNING: /lib/modules/2.6.32-573.18.1.el6.x86_64/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko needs unknown symbol ib_query_device
WARNING: /lib/modules/2.6.32-573.18.1.el6.x86_64/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko needs unknown symbol ib_alloc_pd
WARNING: /lib/modules/2.6.32-573.18.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_core_destroy_rq_tracked
WARNING: /lib/modules/2.6.32-573.18.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_core_query_q_counter
WARNING: /lib/modules/2.6.32-573.18.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_query_nic_vport_qkey_viol_cntr
WARNING: /lib/modules/2.6.32-573.18.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_core_create_sq_tracked
WARNING: /lib/modules/2.6.32-573.18.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_core_attach_nvmf_ns
WARNING: /lib/modules/2.6.32-573.18.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_nic_vport_update_local_lb
WARNING: /lib/modules/2.6.32-573.18.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_core_modify_hca_vport_context
WARNING: /lib/modules/2.6.32-573.18.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_rl_add_rate
WARNING: /lib/modules/2.6.32-573.18.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_create_auto_grouped_flow_table
WARNING: /lib/modules/2.6.32-573.18.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_core_create_rqt
WARNING: /lib/modules/2.6.32-573.18.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_query_hca_vport_node_guid
WARNING: /lib/modules/2.6.32-573.18.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_core_query_vendor_id
WARNING: /lib/modules/2.6.32-573.18.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_core_query_rq
WARNING: /lib/modules/2.6.32-573.18.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_core_alloc_q_counter
WARNING: /lib/modules/2.6.32-573.18.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_core_create_dct
WARNING: /lib/modules/2.6.32-573.18.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_core_set_delay_drop
WARNING: /lib/modules/2.6.32-573.18.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_core_dealloc_q_counter
WARNING: /lib/modules/2.6.32-573.18.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_core_arm_dct
WARNING: /lib/modules/2.6.32-573.18.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_core_create_tis
WARNING: /lib/modules/2.6.32-573.18.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_core_create_tir
WARNING: /lib/modules/2.6.32-573.18.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_cmd_create_vport_lag
WARNING: /lib/modules/2.6.32-573.18.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_unregister_interface
WARNING: /lib/modules/2.6.32-573.18.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_query_min_inline
WARNING: /lib/modules/2.6.32-573.18.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_core_dealloc_transport_domain
WARNING: /lib/modules/2.6.32-573.18.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_query_nic_vport_system_image_guid
WARNING: /lib/modules/2.6.32-573.18.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_lag_get_roce_netdev
WARNING: /lib/modules/2.6.32-573.18.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_add_flow_rules
WARNING: /lib/modules/2.6.32-573.18.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_destroy_flow_table
WARNING: /lib/modules/2.6.32-573.18.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_get_flow_namespace
WARNING: /lib/modules/2.6.32-573.18.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_core_destroy_tir
WARNING: /lib/modules/2.6.32-573.18.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_put_uars_page
WARNING: /lib/modules/2.6.32-573.18.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_get_uars_page
WARNING: /lib/modules/2.6.32-573.18.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_query_nic_vport_node_guid
WARNING: /lib/modules/2.6.32-573.18.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_core_detach_nvmf_ns
WARNING: /lib/modules/2.6.32-573.18.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_core_create_nvmf_backend_ctrl
WARNING: /lib/modules/2.6.32-573.18.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_del_flow_rules
WARNING: /lib/modules/2.6.32-573.18.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_rdma_netdev_alloc
WARNING: /lib/modules/2.6.32-573.18.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_core_modify_sq
WARNING: /lib/modules/2.6.32-573.18.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_query_hca_vport_system_image_guid
WARNING: /lib/modules/2.6.32-573.18.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_core_query_vport_counter
WARNING: /lib/modules/2.6.32-573.18.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_core_destroy_nvmf_backend_ctrl
WARNING: /lib/modules/2.6.32-573.18.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_query_port_max_mtu
WARNING: /lib/modules/2.6.32-573.18.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_query_hca_vport_gid
WARNING: /lib/modules/2.6.32-573.18.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_nic_vport_disable_roce
WARNING: /lib/modules/2.6.32-573.18.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_create_lag_demux_flow_table
WARNING: /lib/modules/2.6.32-573.18.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_core_destroy_sq_tracked
WARNING: /lib/modules/2.6.32-573.18.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_rl_remove_rate
WARNING: /lib/modules/2.6.32-573.18.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_core_create_mkey_cb
WARNING: /lib/modules/2.6.32-573.18.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_query_port_eth_proto_oper
WARNING: /lib/modules/2.6.32-573.18.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_core_create_rq_tracked
WARNING: /lib/modules/2.6.32-573.18.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_core_set_dc_cnak_trace
WARNING: /lib/modules/2.6.32-573.18.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_core_destroy_rqt
WARNING: /lib/modules/2.6.32-573.18.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_core_dct_query
WARNING: /lib/modules/2.6.32-573.18.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_rdma_netdev_free
WARNING: /lib/modules/2.6.32-573.18.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_query_port_vl_hw_cap
WARNING: /lib/modules/2.6.32-573.18.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_query_hca_vport_pkey
WARNING: /lib/modules/2.6.32-573.18.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_query_port_ib_proto_oper
WARNING: /lib/modules/2.6.32-573.18.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_query_hca_vport_context
WARNING: /lib/modules/2.6.32-573.18.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_query_port_oper_mtu
WARNING: /lib/modules/2.6.32-573.18.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_register_interface
WARNING: /lib/modules/2.6.32-573.18.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_nic_vport_enable_roce
WARNING: /lib/modules/2.6.32-573.18.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_core_modify_rq
WARNING: /lib/modules/2.6.32-573.18.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_core_destroy_tis
WARNING: /lib/modules/2.6.32-573.18.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_core_modify_tis
WARNING: /lib/modules/2.6.32-573.18.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_query_port_link_width_oper
WARNING: /lib/modules/2.6.32-573.18.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_core_modify_cq_moderation
WARNING: /lib/modules/2.6.32-573.18.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_core_destroy_dct
WARNING: /lib/modules/2.6.32-573.18.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_core_query_ib_ppcnt
WARNING: /lib/modules/2.6.32-573.18.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_alloc_bfreg
WARNING: /lib/modules/2.6.32-573.18.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_vector2eqn
WARNING: /lib/modules/2.6.32-573.18.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_lag_is_active
WARNING: /lib/modules/2.6.32-573.18.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_free_bfreg
WARNING: /lib/modules/2.6.32-573.18.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_core_query_sq
WARNING: /lib/modules/2.6.32-573.18.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_core_alloc_transport_domain
WARNING: /lib/modules/2.6.32-573.18.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_cmd_destroy_vport_lag
WARNING: /lib/modules/2.6.32-573.22.1.el6.x86_64/kernel/drivers/net/mlx4/mlx4_en.ko needs unknown symbol mlx4_test_interrupts
WARNING: /lib/modules/2.6.32-573.22.1.el6.x86_64/kernel/drivers/net/mlx4/mlx4_en.ko needs unknown symbol mlx4_set_stats_bitmap
WARNING: /lib/modules/2.6.32-573.22.1.el6.x86_64/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko needs unknown symbol ib_query_device
WARNING: /lib/modules/2.6.32-573.22.1.el6.x86_64/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko needs unknown symbol ib_alloc_pd
WARNING: /lib/modules/2.6.32-573.22.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_core_destroy_rq_tracked
WARNING: /lib/modules/2.6.32-573.22.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_core_query_q_counter
WARNING: /lib/modules/2.6.32-573.22.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_query_nic_vport_qkey_viol_cntr
WARNING: /lib/modules/2.6.32-573.22.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_core_create_sq_tracked
WARNING: /lib/modules/2.6.32-573.22.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_core_attach_nvmf_ns
WARNING: /lib/modules/2.6.32-573.22.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_nic_vport_update_local_lb
WARNING: /lib/modules/2.6.32-573.22.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_core_modify_hca_vport_context
WARNING: /lib/modules/2.6.32-573.22.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_rl_add_rate
WARNING: /lib/modules/2.6.32-573.22.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_create_auto_grouped_flow_table
WARNING: /lib/modules/2.6.32-573.22.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_core_create_rqt
WARNING: /lib/modules/2.6.32-573.22.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_query_hca_vport_node_guid
WARNING: /lib/modules/2.6.32-573.22.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_core_query_vendor_id
WARNING: /lib/modules/2.6.32-573.22.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_core_query_rq
WARNING: /lib/modules/2.6.32-573.22.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_core_alloc_q_counter
WARNING: /lib/modules/2.6.32-573.22.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_core_create_dct
WARNING: /lib/modules/2.6.32-573.22.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_core_set_delay_drop
WARNING: /lib/modules/2.6.32-573.22.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_core_dealloc_q_counter
WARNING: /lib/modules/2.6.32-573.22.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_core_arm_dct
WARNING: /lib/modules/2.6.32-573.22.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_core_create_tis
WARNING: /lib/modules/2.6.32-573.22.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_core_create_tir
WARNING: /lib/modules/2.6.32-573.22.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_cmd_create_vport_lag
WARNING: /lib/modules/2.6.32-573.22.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_unregister_interface
WARNING: /lib/modules/2.6.32-573.22.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_query_min_inline
WARNING: /lib/modules/2.6.32-573.22.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_core_dealloc_transport_domain
WARNING: /lib/modules/2.6.32-573.22.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_query_nic_vport_system_image_guid
WARNING: /lib/modules/2.6.32-573.22.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_lag_get_roce_netdev
WARNING: /lib/modules/2.6.32-573.22.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_add_flow_rules
WARNING: /lib/modules/2.6.32-573.22.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_destroy_flow_table
WARNING: /lib/modules/2.6.32-573.22.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_get_flow_namespace
WARNING: /lib/modules/2.6.32-573.22.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_core_destroy_tir
WARNING: /lib/modules/2.6.32-573.22.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_put_uars_page
WARNING: /lib/modules/2.6.32-573.22.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_get_uars_page
WARNING: /lib/modules/2.6.32-573.22.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_query_nic_vport_node_guid
WARNING: /lib/modules/2.6.32-573.22.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_core_detach_nvmf_ns
WARNING: /lib/modules/2.6.32-573.22.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_core_create_nvmf_backend_ctrl
WARNING: /lib/modules/2.6.32-573.22.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_del_flow_rules
WARNING: /lib/modules/2.6.32-573.22.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_rdma_netdev_alloc
WARNING: /lib/modules/2.6.32-573.22.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_core_modify_sq
WARNING: /lib/modules/2.6.32-573.22.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_query_hca_vport_system_image_guid
WARNING: /lib/modules/2.6.32-573.22.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_core_query_vport_counter
WARNING: /lib/modules/2.6.32-573.22.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_core_destroy_nvmf_backend_ctrl
WARNING: /lib/modules/2.6.32-573.22.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_query_port_max_mtu
WARNING: /lib/modules/2.6.32-573.22.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_query_hca_vport_gid
WARNING: /lib/modules/2.6.32-573.22.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_nic_vport_disable_roce
WARNING: /lib/modules/2.6.32-573.22.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_create_lag_demux_flow_table
WARNING: /lib/modules/2.6.32-573.22.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_core_destroy_sq_tracked
WARNING: /lib/modules/2.6.32-573.22.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_rl_remove_rate
WARNING: /lib/modules/2.6.32-573.22.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_core_create_mkey_cb
WARNING: /lib/modules/2.6.32-573.22.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_query_port_eth_proto_oper
WARNING: /lib/modules/2.6.32-573.22.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_core_create_rq_tracked
WARNING: /lib/modules/2.6.32-573.22.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_core_set_dc_cnak_trace
WARNING: /lib/modules/2.6.32-573.22.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_core_destroy_rqt
WARNING: /lib/modules/2.6.32-573.22.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_core_dct_query
WARNING: /lib/modules/2.6.32-573.22.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_rdma_netdev_free
WARNING: /lib/modules/2.6.32-573.22.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_query_port_vl_hw_cap
WARNING: /lib/modules/2.6.32-573.22.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_query_hca_vport_pkey
WARNING: /lib/modules/2.6.32-573.22.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_query_port_ib_proto_oper
WARNING: /lib/modules/2.6.32-573.22.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_query_hca_vport_context
WARNING: /lib/modules/2.6.32-573.22.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_query_port_oper_mtu
WARNING: /lib/modules/2.6.32-573.22.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_register_interface
WARNING: /lib/modules/2.6.32-573.22.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_nic_vport_enable_roce
WARNING: /lib/modules/2.6.32-573.22.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_core_modify_rq
WARNING: /lib/modules/2.6.32-573.22.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_core_destroy_tis
WARNING: /lib/modules/2.6.32-573.22.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_core_modify_tis
WARNING: /lib/modules/2.6.32-573.22.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_query_port_link_width_oper
WARNING: /lib/modules/2.6.32-573.22.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_core_modify_cq_moderation
WARNING: /lib/modules/2.6.32-573.22.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_core_destroy_dct
WARNING: /lib/modules/2.6.32-573.22.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_core_query_ib_ppcnt
WARNING: /lib/modules/2.6.32-573.22.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_alloc_bfreg
WARNING: /lib/modules/2.6.32-573.22.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_vector2eqn
WARNING: /lib/modules/2.6.32-573.22.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_lag_is_active
WARNING: /lib/modules/2.6.32-573.22.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_free_bfreg
WARNING: /lib/modules/2.6.32-573.22.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_core_query_sq
WARNING: /lib/modules/2.6.32-573.22.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_core_alloc_transport_domain
WARNING: /lib/modules/2.6.32-573.22.1.el6.x86_64/weak-updates/mlnx-ofa_kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko needs unknown symbol mlx5_cmd_destroy_vport_lag

Reboot the server

root@linux:~ # shutdown -r now

Broadcast message from root (pts/0) (Wed Feb 21 16:13:26 2018):

The system is going down for reboot NOW!