Network disconnection between hosts

Description

The system periodically uses fping to check network connectivity between hosts. When a peer host is continuously unreachable for a period of time, the network disconnection alert is triggered.

Alert message

• The ping operation from the following { .labels.count } hosts to the management IP { .labels.ip } associated with the host { .labels.hostname } timed out: { .labels.can_not_ping_hostnames }.

• The ping operation from the following { .labels.count } hosts to the storage IP { .labels.ip } associated with the host { .labels.hostname } timed out: { .labels.can_not_ping_hostnames }.

• The ping operation from the following { .labels.count } hosts to the access IP { .labels.ip } associated with the host { .labels.hostname } timed out: { .labels.can_not_ping_hostnames}.

• The communication link from the host { .labels.name } to the following hosts is experiencing anomalies: { .labels.chunks }.

• The ping operation from the following { .labels.count } SCVMs to the management IP { .labels.ip } associated with the SCVM { .labels.hostname } timed out: { .labels.can_not_ping_hostnames }.

• The ping operation from the following { .labels.count } SCVMs to the storage IP { .labels.ip } associated with the SCVM { .labels.hostname } timed out: { .labels.can_not_ping_hostnames }.

Impact

When the network is disconnected, the related storage or access services become inaccessible, causing service interruption.

Cause

Possible causes include:

• System crash or process hang

• NIC failure

• Switch or uplink failure

• Cable or physical connection issue

Troubleshooting approach

Check whether the configuration of virtualized network components such as OVS and NIC drivers is abnormal, replace the network devices, and retest.

Solution

Based on the identified cause, adjust the configuration of virtual network components or replace the faulty physical network devices (NIC, cable, switch, etc.).