The alert is triggered when system partition space usage is too high, posing a risk that system services may fail due to insufficient storage space.
Host { .labels.hostname }: The system partition has used more than { .threshold }.
Witness node { .labels.hostname }: The system partition has used more than { .threshold }.
SCVM { .labels.hostname }: The system partition has used more than { .threshold }.
When space usage reaches 100%, the corresponding host may not function normally.
This may be caused by log files or other data consuming excessive space on the system partition, or by an anomaly in a service process. Log space consumed by system services is subject to quota limits and is periodically compressed and reclaimed. This type of space alert is typically caused by manual operations, such as temporarily uploading large ISO files, or generating virtual machine or program core dump files outside the designated directories during troubleshooting and failing to clean them up, resulting in insufficient root partition space.
On the affected node, run df -h to check the space usage of the / mount point.
Run du -shx | sort -h in each directory level to identify large files. Check the /home directory first for suspicious temporary files, and pay particular attention to the /var/log/ and /var/lib directories.
If the logs in the /var/log/zbs directory are confirmed to be consuming excessive space, consult an Arcfra after-sales engineer before deleting older log files of the same name.
Clean up files with excessive space usage, or restore the corresponding services to normal operation.