2. Network Devices on master
The master nodes have multiple network ports. For our setup, one of them will be used for internet/outside access, another will be configured for the management network, which is used to control compute nodes with IPMI. And a third one port will be connected to the cluster network, used for SSH, network booting and data transfer.
Note
Log in to the master node assigned to you
[user@hostname ~]$ ssh root@<ip_address>
[root@master ~]#
The root password is orca2026.
2.1. Identify your available network devices
The ip link command will show you all available network devices and their state.
Note
The interface names are assigned automatically by systemd, and therefore they might be different on your system. For further information about the naming scheme, please follow this link.
[root@master ~]# ip link
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN mode DEFAULT group default qlen 1000
link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
2: eno1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000
link/ether 7c:c2:55:ed:29:d0 brd ff:ff:ff:ff:ff:ff
altname enp2s0
altname enx7cc255ed29d0
3: eno2: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc mq state DOWN mode DEFAULT group default qlen 1000
link/ether 7c:c2:55:ed:29:d1 brd ff:ff:ff:ff:ff:ff
altname enp5s0
altname enx7cc255ed29d1
4: eno3: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc mq state DOWN mode DEFAULT group default qlen 1000
link/ether 7c:c2:55:ed:29:d2 brd ff:ff:ff:ff:ff:ff
altname enp6s0
altname enx7cc255ed29d2
5: eno4: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc mq state DOWN mode DEFAULT group default qlen 1000
link/ether 7c:c2:55:ed:29:d3 brd ff:ff:ff:ff:ff:ff
altname enp7s0
altname enx7cc255ed29d3
Danger
Do not change anything on eno1. This is the network connection
that allows you to access the master node remotely! Use eno2 and eno3 for the management and cluster network.
Network |
Interface |
|---|---|
Internet |
eno1 |
Management (IPMI) |
eno2 |
Cluster (SSH) |
eno3 |
You can change the state of an interface with the ip link set command.
[root@master ~]# ip link set eno2 down
[root@master ~]# ip link
...
3: eno2: <BROADCAST,MULTICAST> mtu 1500 qdisc mq state DOWN mode DEFAULT group default qlen 1000
...
[root@master ~]# ip link set eno2 up
[root@master ~]# ip link
...
3: eno2: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000
...
To get more details about your connection, you can use the ethtool command:
[root@master ~]# ethtool eno2
Settings for eno2:
Supported ports: [ TP ]
Supported link modes: 10baseT/Half 10baseT/Full
100baseT/Half 100baseT/Full
1000baseT/Full
Supported pause frame use: Symmetric
Supports auto-negotiation: Yes
Supported FEC modes: Not reported
Advertised link modes: 10baseT/Half 10baseT/Full
100baseT/Half 100baseT/Full
1000baseT/Full
Advertised pause frame use: Symmetric
Advertised auto-negotiation: Yes
Advertised FEC modes: Not reported
Speed: 1000Mb/s
Duplex: Full
Auto-negotiation: on
Port: Twisted Pair
PHYAD: 1
Transceiver: internal
MDI-X: on (auto)
Supports Wake-on: pumbg
Wake-on: g
Current message level: 0x00000007 (7)
drv probe link
Link detected: yes
It will report if it can find a physical link and what transfer rate it supports. In the above example you can see that the connection is running with 1000Mb/s or 1Gb/s.
Having a link does not give you an IP. You either have to request one via DHCP or set it statically.
Our first network device will be connected to the outside world and will get its IP via DHCP. The other two interfaces are connected to isolated networks, for which we will have to set static IPs.