API Doc
Search Docs...
⌘ K
OverviewDeploymentManagementOperationReferenceGlossary
    ACOS 6.3.0
  • Acrfra Cloud Operation System cluster>
  • ACOS fault handling>
  • Hosts

High system partition space usage on a host

Description

The alert is triggered when system partition space usage is too high, posing a risk that system services may fail due to insufficient storage space.

Alert message

  • Host { .labels.hostname }: The system partition has used more than { .threshold }.

  • Witness node { .labels.hostname }: The system partition has used more than { .threshold }.

  • SCVM { .labels.hostname }: The system partition has used more than { .threshold }.

Impact

When space usage reaches 100%, the corresponding host may not function normally.

Cause

This may be caused by log files or other data consuming excessive space on the system partition, or by an anomaly in a service process. Log space consumed by system services is subject to quota limits and is periodically compressed and reclaimed. This type of space alert is typically caused by manual operations, such as temporarily uploading large ISO files, or generating virtual machine or program core dump files outside the designated directories during troubleshooting and failing to clean them up, resulting in insufficient root partition space.

Troubleshooting approach

  1. On the affected node, run df -h to check the space usage of the / mount point.

  2. Run du -shx | sort -h in each directory level to identify large files. Check the /home directory first for suspicious temporary files, and pay particular attention to the /var/log/ and /var/lib directories.

  3. If the logs in the /var/log/zbs directory are confirmed to be consuming excessive space, consult an Arcfra after-sales engineer before deleting older log files of the same name.

Solution

Clean up files with excessive space usage, or restore the corresponding services to normal operation.