dashboard-react
    Preparing search index...

    Interface PlacementPreview

    Placement preview returned by the Skulk placement preview endpoint.

    interface PlacementPreview {
        model_id: string;
        sharding: "Pipeline" | "Tensor";
        instance_meta: "MlxRing" | "MlxJaccl" | "LlamaRpc";
        instance: unknown;
        memory_delta_by_node: Record<string, number> | null;
        error: string | null;
        alternative?: boolean;
    }
    Index

    Properties

    model_id sharding instance_meta instance memory_delta_by_node error alternative?

    Properties

    model_id: string
    sharding: "Pipeline" | "Tensor"
    instance_meta: "MlxRing" | "MlxJaccl" | "LlamaRpc"
    instance: unknown
    memory_delta_by_node: Record<string, number> | null
    error: string | null
    alternative?: boolean

    Per-host alternative to the ranked pick: a single-node placement on a host that passes admission but lost the planner ranking (#557).

    Settings

    Member Visibility

    On This Page

    Properties