Configuring private heartbeat links

You now configure the private heartbeat links that LLT uses.

VCS provides the option to use LLT over Ethernet or LLT over UDP (User Datagram Protocol) or LLT over RDMA. Veritas recommends that you configure heartbeat links that use LLT over Ethernet or LLT over RDMA for high performance, unless hardware requirements force you to use LLT over UDP. If you want to configure LLT over UDP, make sure you meet the prerequisites.

You must not configure LLT heartbeat using the links that are part of aggregated links. For example, link1, link2 can be aggregated to create an aggregated link, aggr1. You can use aggr1 as a heartbeat link, but you must not use either link1 or link2 as heartbeat links.

See Using the UDP layer for LLT.

See Using LLT over RDMA: supported use cases .

The following procedure helps you configure LLT heartbeat links.

To configure private heartbeat links

  1. Choose one of the following options at the installer prompt based on whether you want to configure LLT over Ethernet or LLT over UDP or LLT over RDMA.

    • Option 1: Configure the heartbeat links using LLT over Ethernet (answer installer questions)

      Enter the heartbeat link details at the installer prompt to configure LLT over Ethernet.

      Skip to step 2.

    • Option 2: Configure the heartbeat links using LLT over UDP (answer installer questions)

      Make sure that each NIC you want to use as heartbeat link has an IP address configured. Enter the heartbeat link details at the installer prompt to configure LLT over UDP. If you had not already configured IP addresses to the NICs, the installer provides you an option to detect the IP address for a given NIC.

      Skip to step 3.

    • Option 3: Configure the heartbeat links using LLT over RDMA (answer installer questions)

      Make sure that each RDMA enabled NIC (RNIC) you want to use as heartbeat link has an IP address configured. Enter the heartbeat link details at the installer prompt to configure LLT over RDMA. If you had not already configured IP addresses to the RNICs, the installer provides you an option to detect the IP address for a given RNIC.

      Skip to step 4.

    • Option 4: Automatically detect configuration for LLT over Ethernet

      Allow the installer to automatically detect the heartbeat link details to configure LLT over Ethernet. The installer tries to detect all connected links between all systems.

      Make sure that you activated the NICs for the installer to be able to detect and automatically configure the heartbeat links.

      Skip to step 7.

      Note:

      Option 4 is not available when the configuration is a single node configuration.

  2. If you chose option 1, enter the network interface card details for the private heartbeat links.

    The installer discovers and lists the network interface cards.

    You must not enter the network interface card that is used for the public network (typically eth0.)

    Enter the NIC for the first private heartbeat link on sys1:
    [b,q,?] eth1
    eth1 has an IP address configured on it. It could be a 
    public NIC on sys1.
    Are you sure you want to use eth1 for the first private 
    heartbeat link? [y,n,q,b,?] (n) y
    Would you like to configure a second private heartbeat link?
    [y,n,q,b,?] (y)   
    Enter the NIC for the second private heartbeat link on sys1:
    [b,q,?] eth2
    eth2 has an IP address configured on it. It could be a 
    public NIC on sys1.
    Are you sure you want to use eth2 for the second private 
    heartbeat link? [y,n,q,b,?] (n) y
    Would you like to configure a third private heartbeat link?
    [y,n,q,b,?](n) 
    Do you want to configure an additional low priority heartbeat 
    link? [y,n,q,b,?] (n)
  3. If you chose option 2, enter the NIC details for the private heartbeat links. This step uses examples such as private_NIC1 or private_NIC2 to refer to the available names of the NICs.
    Enter the NIC for the first private heartbeat link on sys1: [b,q,?]
    private_NIC1
    Some configured IP addresses have been found on 
    the NIC private_NIC1 in sys1,
    Do you want to choose one for the first private heartbeat link? [y,n,q,?] (y)
    Please select one IP address:
         1)  192.168.0.1/24
         2)  192.168.1.233/24
         b)  Back to previous menu
    
    Please select one IP address: [1-2,b,q,?] (1)
    Enter the UDP port for the first private heartbeat link on sys1:
    [b,q,?] (50000)
    
    Enter the NIC for the second private heartbeat link on sys1: [b,q,?]
    private_NIC2
    Some configured IP addresses have been found on the 
    NIC private_NIC2 in sys1,
    Do you want to choose one for the second 
    private heartbeat link? [y,n,q,?] (y)
    Please select one IP address:
         1)  192.168.1.1/24
         2)  192.168.2.233/24
         b)  Back to previous menu
    
    Please select one IP address: [1-2,b,q,?] (1) 1
    Enter the UDP port for the second private heartbeat link on sys1:
    [b,q,?] (50001)
    
    Would you like to configure a third private heartbeat
    link? [y,n,q,b,?] (n)
    
    Do you want to configure an additional low-priority heartbeat
    link? [y,n,q,b,?] (n) y
    
    Enter the NIC for the low-priority heartbeat link on sys1: [b,q,?]
    private_NIC0
    Some configured IP addresses have been found on 
    the NIC private_NIC0 in sys1,
    Do you want to choose one for the low-priority 
    heartbeat link? [y,n,q,?] (y)
    Please select one IP address:
         1)  10.200.59.233/22
         2)  192.168.3.1/22
         b)  Back to previous menu
    
    Please select one IP address: [1-2,b,q,?] (1) 2
    Enter the UDP port for the low-priority heartbeat link on sys1: 
    [b,q,?] (50010)
  4. If you chose option 3, choose the interconnect type to configure RDMA.
    1)  Converged Ethernet (RoCE)
    2)  InfiniBand
    b)  Back to previous menu
    
    Choose the RDMA interconnect type [1-2,b,q,?] (1) 2
    

    The system displays the details such as the required OS files, drivers required for RDMA , and the IP addresses for the NICs.

    A sample output of the IP addresses assigned to the RDMA enabled NICs using InfiniBand network. Note that with RoCE, the RDMA NIC values are represented as eth0, eth1, and so on.

    System    				RDMA NIC          IP Address
    =================================================================
    sys1           ib0               192.168.0.1
    sys1           ib1               192.168.3.1
    sys2           ib0               192.168.0.2
    sys2           ib1               192.168.3.2
    
  5. If you chose option 3, enter the NIC details for the private heartbeat links. This step uses RDMA over an InfiniBand network. With RoCE as the interconnect type, RDMA NIC is represented as Ethernet (eth).

    Enter the NIC for the first private heartbeat 
    link (RDMA) on sys1: [b,q,?] <ib0>
    
    Do you want to use address 192.168.0.1 for the 
    first private heartbeat link on sys1: [y,n,q,b,?] (y)
    
    Enter the port for the first private heartbeat 
    link (RDMA) on sys1: [b,q,?] (50000) ?
    
    Would you like to configure a second private 
    heartbeat link? [y,n,q,b,?] (y)   
    Enter the NIC for the second private heartbeat link (RDMA) on sys1: 
    [b,q,?] (ib1) 
    
    Do you want to use the address 192.168.3.1 for the second  
    private heartbeat link on sys1: [y,n,q,b,?] (y) 
    Enter the port for the second private heartbeat link (RDMA) on sys1: 
    [b,q,?] (50001)
    
    Do you want to configure an additional low-priority heartbeat link?
    [y,n,q,b,?] (n)
  6. Choose whether to use the same NIC details to configure private heartbeat links on other systems.
    Are you using the same NICs for private heartbeat links on all 
    systems? [y,n,q,b,?] (y)

    If you want to use the NIC details that you entered for sys1, make sure the same NICs are available on each system. Then, enter y at the prompt.

    If the NIC device names are different on some of the systems, enter n. Provide the NIC details for each system as the program prompts.

    For LLT over UDP and LLT over RDMA, if you want to use the same NICs on other systems, you must enter unique IP addresses on each NIC for other systems.

  7. If you chose option 4, the installer detects NICs on each system and network links, and sets link priority.

    If the installer fails to detect heartbeat links or fails to find any high-priority links, then choose option 1 or option 2 to manually configure the heartbeat links.

    See step 2 for option 1, or step 3 for option 2 or step 4 for option 3.

  8. Enter a unique cluster ID:
    Enter a unique cluster ID number between 0-65535: [b,q,?] (60842)

    The cluster cannot be configured if the cluster ID 60842 is in use by another cluster. Installer performs a check to determine if the cluster ID is duplicate. The check takes less than a minute to complete.

    Would you like to check if the cluster ID is in use by another 
    cluster? [y,n,q] (y)
  9. Verify and confirm the information that the installer summarizes.