Skip to main content

RunnerFlightRecorderEntry

One retained runner flight-recorder entry.

atAt (string)required

UTC timestamp when the runner emitted the update.

phasePhase (string)required

Runner phase at this entry.

Possible values: [created, idle, connect_group, load_model, warmup, task_submission, task_agreement, prompt_build, vision_preprocess, kv_cache_lookup, prefill_barrier, prefill_pipeline, prefill_stream, decode_barrier, decode_wait_first_token, decode_stream, parser, cancel_requested, cancel_observed, completion, error, shutdown_cleanup]

eventEvent (string)required

Short event name within the phase.

detail object

Compact human-readable detail for diagnostics.

anyOf
string
attrs object

Structured low-cardinality diagnostic attributes.

property name* object
anyOf
string
context objectrequired

Stable runner identity fields for this entry.

nodeIdNodeid (string)required

Node ID that owns this runner.

runnerIdRunnerid (string)required

Runner ID.

pid object

Runner subprocess PID.

anyOf
integer
instanceIdInstanceid (string)required

Instance ID.

modelIdModelid (string)required

Model assigned to this runner.

rankRank (integer)required

Distributed rank for this runner.

worldSizeWorldsize (integer)required

Distributed world size.

startLayerStartlayer (integer)required

Inclusive first layer on this shard.

endLayerEndlayer (integer)required

Exclusive final layer on this shard.

nLayersNlayers (integer)required

Total model layers.

taskId object

Task ID associated with the entry, when known.

anyOf
string
commandId object

Command ID associated with the entry, when known.

anyOf
string
mlxMemory object

MLX memory snapshot captured with this entry, when present.

anyOf
generatedAtGeneratedat (string)required

UTC timestamp when the snapshot was taken.

active object

Currently active MLX memory, when the runtime exposes it.

anyOf
inBytesInbytes (integer)
Default value: 0
cache object

MLX cache memory, when the runtime exposes it.

anyOf
inBytesInbytes (integer)
Default value: 0
peak object

Peak MLX memory since the last reset, when available.

anyOf
inBytesInbytes (integer)
Default value: 0
wiredLimit object

Configured MLX wired memory limit when known. Current MLX releases do not expose a getter on all platforms, so this may be null.

anyOf
inBytesInbytes (integer)
Default value: 0
sourceSource (string)required

Runtime module that supplied the measurement, such as mlx.core.

RunnerFlightRecorderEntry
{
"at": "string",
"phase": "created",
"event": "string",
"detail": "string",
"attrs": {},
"context": {
"nodeId": "string",
"runnerId": "string",
"pid": 0,
"instanceId": "string",
"modelId": "string",
"rank": 0,
"worldSize": 0,
"startLayer": 0,
"endLayer": 0,
"nLayers": 0
},
"taskId": "string",
"commandId": "string",
"mlxMemory": {
"generatedAt": "string",
"active": {
"inBytes": 0
},
"cache": {
"inBytes": 0
},
"peak": {
"inBytes": 0
},
"wiredLimit": {
"inBytes": 0
},
"source": "string"
}
}