Skip to main content

InstancePlacementDiagnostics

Cluster placement analysis for one model instance.

instanceIdInstanceid (string)required

Instance ID.

modelIdModelid (string)required

Placed model ID.

masterNodeId object

Current master node ID, when known.

anyOf
string
masterIsPlacementNodeMasterisplacementnode (boolean)required

Whether the current master is part of this model placement.

localNodeIsPlacementNodeLocalnodeisplacementnode (boolean)required

Whether the API node is part of this model placement.

placementNodeIdsstring[]

Node IDs participating in the placement.

runners object[]

Per-runner placement details.

  • Array [
    • runnerIdRunnerid (string)required

    Runner ID.

    nodeIdNodeid (string)required

    Node ID assigned to this runner.

    friendlyName object

    Friendly node name, when known.

    anyOf
    string
    statusKind object

    Current event-sourced runner status variant.

    anyOf
    string
    deviceRankDevicerank (integer)required

    Distributed device rank.

    worldSizeWorldsize (integer)required

    Distributed world size.

    startLayerStartlayer (integer)required

    Inclusive first model layer on this shard.

    endLayerEndlayer (integer)required

    Exclusive final model layer on this shard.

    nLayersNlayers (integer)required

    Total number of model layers.

    isLocalIslocal (boolean)required

    Whether this assignment is on the API node.

    isMasterIsmaster (boolean)required

    Whether this assignment is on the master node.

    tasks object[]

    Event-sourced tasks associated with this runner assignment.

  • Array [
    • taskIdTaskid (string)required

    Skulk task ID.

    taskKindTaskkind (string)required

    Concrete task model name.

    taskStatusTaskstatus (string)required

    Current event-sourced task status.

    instanceIdInstanceid (string)required

    Instance associated with the task.

    commandId object

    External command ID for user-facing inference tasks.

    anyOf
    string
    runnerId object

    Runner assigned to the task, if known.

    anyOf
    string
    modelId object

    Model associated with the task, if known.

    anyOf
    string
  • ]
  • ]
    • warningsstring[]

    Heuristic warnings that may help explain a stuck placement.

    InstancePlacementDiagnostics
    {
      "instanceId": "string",
      "modelId": "string",
      "masterNodeId": "string",
      "masterIsPlacementNode": true,
      "localNodeIsPlacementNode": true,
      "placementNodeIds": [
        "string"
      ],
      "runners": [
        {
          "runnerId": "string",
          "nodeId": "string",
          "friendlyName": "string",
          "statusKind": "string",
          "deviceRank": 0,
          "worldSize": 0,
          "startLayer": 0,
          "endLayer": 0,
          "nLayers": 0,
          "isLocal": true,
          "isMaster": true,
          "tasks": [
            {
              "taskId": "string",
              "taskKind": "string",
              "taskStatus": "string",
              "instanceId": "string",
              "commandId": "string",
              "runnerId": "string",
              "modelId": "string"
            }
          ]
        }
      ],
      "warnings": [
        "string"
      ]
    }