Skip to main content

NodeResourceDiagnostics

Resource readings for one node from gathered state and local psutil.

gatheredMemory object

Last event-sourced memory reading for this node.

anyOf
ramTotal objectrequired
inBytesInbytes (integer)
Default value: 0
ramAvailable objectrequired
inBytesInbytes (integer)
Default value: 0
swapTotal objectrequired
inBytesInbytes (integer)
Default value: 0
swapAvailable objectrequired
inBytesInbytes (integer)
Default value: 0
currentMemory object

Live memory reading from the API process.

anyOf
ramTotal objectrequired
inBytesInbytes (integer)
Default value: 0
ramAvailable objectrequired
inBytesInbytes (integer)
Default value: 0
swapTotal objectrequired
inBytesInbytes (integer)
Default value: 0
swapAvailable objectrequired
inBytesInbytes (integer)
Default value: 0
currentWired object

Live OS-level wired (unpageable) memory in use (macOS only). Read locally on this endpoint — deliberately NOT on the gossiped MemoryUsage, whose schema rides extra=forbid events — to detect leaked wired memory after an abnormal Metal termination (#239).

anyOf
inBytesInbytes (integer)
Default value: 0
disk object

Last event-sourced disk reading for this node.

anyOf
total objectrequired
inBytesInbytes (integer)
Default value: 0
available objectrequired
inBytesInbytes (integer)
Default value: 0
system object

Last event-sourced system performance reading.

anyOf
gpuUsageGpuusage (number)
Default value: 0
tempTemp (number)
Default value: 0
sysPowerSyspower (number)
Default value: 0
pcpuUsagePcpuusage (number)
Default value: 0
ecpuUsageEcpuusage (number)
Default value: 0
accelerator object
anyOf
vendorVendor (string)

Possible values: [apple, amd, nvidia, intel, cpu, unknown]

Default value: unknown
nameName (string)
Default value: Unknown
utilizationRatio object
anyOf
number
vramTotalBytes object
anyOf
integer
vramUsedBytes object
anyOf
integer
gttTotalBytes object

GPU-mappable host (GTT) memory, for unified-memory APUs (e.g. AMD Strix Halo). On such a node the GPU addresses system RAM beyond the BIOS VRAM carve-out through GTT, so the usable GPU pool is far larger than vram_total_bytes (placement uses this to admit big models on a UMA node). None on discrete GPUs / collectors that do not report it.

anyOf
integer
powerWatts object
anyOf
number
temperatureCelsius object
anyOf
number
clockMhz object
anyOf
integer
computeCapability object

Discrete-GPU compute capability as "<major>.<minor>" (NVIDIA SM level), e.g. "8.0" (A100 Ampere), "9.0" (H100 Hopper), "10.0" (B100/B200 Blackwell), "12.0" (RTX 50 Blackwell). The engine/quant/placement decision keys on this, not on vendor: the same model+engine performs oppositely across generations (a benchmark showed vLLM's MXFP4 path losing single-stream on Ampere, which has no native FP4, but winning on Blackwell, which does). None on collectors that do not report it (AMD sysfs, Apple).

anyOf
string
nativeFp4 object

Whether the GPU accelerates FP4 natively (Blackwell sm100+, i.e. SM level (major, minor) >= (10, 0)). Derived at the collector boundary from the parsed compute capability (a numeric tuple compare, not a string compare). None when unmeasured.

anyOf
boolean
nativeFp8 object

Whether the GPU accelerates FP8 natively (Ada sm89 / Hopper sm90 and later). Derived at the collector boundary from the compute capability. None when unmeasured.

anyOf
boolean
network object

Last event-sourced network interface reading.

anyOf
interfaces object[]
  • Array [
    • nameName (string)required
    ipAddressIpaddress (string)required
    interfaceTypeInterfacetype (string)

    Possible values: [wifi, ethernet, maybe_ethernet, thunderbolt, unknown]

    Default value: unknown
  • ]
    • NodeResourceDiagnostics
    {
      "gatheredMemory": {
        "ramTotal": {
          "inBytes": 0
        },
        "ramAvailable": {
          "inBytes": 0
        },
        "swapTotal": {
          "inBytes": 0
        },
        "swapAvailable": {
          "inBytes": 0
        }
      },
      "currentMemory": {
        "ramTotal": {
          "inBytes": 0
        },
        "ramAvailable": {
          "inBytes": 0
        },
        "swapTotal": {
          "inBytes": 0
        },
        "swapAvailable": {
          "inBytes": 0
        }
      },
      "currentWired": {
        "inBytes": 0
      },
      "disk": {
        "total": {
          "inBytes": 0
        },
        "available": {
          "inBytes": 0
        }
      },
      "system": {
        "gpuUsage": 0,
        "temp": 0,
        "sysPower": 0,
        "pcpuUsage": 0,
        "ecpuUsage": 0,
        "accelerator": {
          "vendor": "unknown",
          "name": "Unknown",
          "utilizationRatio": 0,
          "vramTotalBytes": 0,
          "vramUsedBytes": 0,
          "gttTotalBytes": 0,
          "powerWatts": 0,
          "temperatureCelsius": 0,
          "clockMhz": 0,
          "computeCapability": "string",
          "nativeFp4": true,
          "nativeFp8": true
        }
      },
      "network": {
        "interfaces": [
          {
            "name": "string",
            "ipAddress": "string",
            "interfaceType": "unknown"
          }
        ]
      }
    }