Configuring IP addresses over InfiniBand Interfaces


Configuring IP addresses over InfiniBand Interfaces
Prev	Configuring RDMA over an InfiniBand network	Next

Perform the following steps to configure IP addresses over the network interfaces which you plan to configure under LLT. These interfaces must not be aggregated interfaces.

Configure IP addresses using Linux ifconfig command. Make sure that the IP address for each link must be from a different subnet.
Typical private IP addresses that you can use are: 192.168.12.1, 192.168.12.2, 192.168.12.3 and so on.
Run the InfiniBand ping test between nodes to ensure that there is InfiniBand level connectivity between nodes.
- On one node, start the ibping server.
  
  # ibping -S
- On the node, get the GUID of an InfiniBand interface that you need to ping from another node.
  
  # ibstat
```
CA 'mlx4_0'
Number of ports: 2
	--
Port 1:
State: Active
---
Port GUID: 0x0002c90300a02af1
Link layer: InfiniBand
```
- Ping the peer node by using its GUID.
  
  # ibping -G 0x0002c90300a02af1
  
  Where, 0x0002c90300a02af1 is the GUID of the server.

Configure IP addresses automatically after restart by creating a new configuration file or by modifying the existing file.

On RHEL, modify the /etc/sysconfig/network-scripts/ directory by modifying the ifcfg-ibX (InfiniBand) configuration file.
On SUSE, modify the /etc/sysconfig/network/ by modifying the ifcfg-ibX (InfiniBand) configuration file.

For example, for an Infiniband interface ib0,
create ifcfg-ib0 file with values for the following parameters.

DEVICE=ib0
BOOTPROTO=static
IPADDR=192.168.27.1
NETMASK=255.255.255.0
NETWORK=192.168.27.0
BROADCAST=192.168.27.255
NM_CONTROLLED=no # This line ensures IPs are plumbed correctly
after bootup and the Network manager does not interfere
with the interfaces
ONBOOT=yes
STARTMODE='auto' # This line is only for SUSE

Prev	Up	Next
Configuring the OpenSM service	Home	Tuning system performance