Skip to main content

ExternalConfiguration

Hypothetical complete remote allocation, not a provider offer.

backendBackend (string)required
engineBuild objectrequired
anyOf
string
hardwareClassesstring[]required
replicaCountReplicacount (integer)required
requestsPerReplicaRequestsperreplica (integer)required
contextPoolTokensContextpooltokens (integer)required
nodesPerReplicaNodesperreplica (integer)
Constant value: 1
Default value: 1
gpusPerNodeGpuspernode (integer)required

Discrete GPU requirement; zero includes CPU and Apple unified-memory hosts.

Possible values: [0, 1]

memoryPoolMemorypool (string)required

Possible values: [ram, vram]

estimatedMemoryBytesPerReplicaEstimatedmemorybytesperreplica (integer)required
minimumMemoryBytesPerNodeMinimummemorybytespernode (integer)required

Physical RAM or VRAM needed to expose the estimated usable working set.

minimumWeightDiskBytesPerNodeMinimumweightdiskbytespernode (integer)required

Selected weights and projector only; no installation or staging allowance.

hostRamBytes object

Unknown for discrete GPU configurations; staging/runtime need extra RAM.

anyOf
integer
offerAvailableOfferavailable (boolean)

No live offer, stock or price was read for this hypothetical specification.

Constant value: false
Default value: false
ExternalConfiguration
{
"backend": "string",
"engineBuild": "string",
"hardwareClasses": [
"string"
],
"replicaCount": 0,
"requestsPerReplica": 0,
"contextPoolTokens": 0,
"nodesPerReplica": 1,
"gpusPerNode": 0,
"memoryPool": "ram",
"estimatedMemoryBytesPerReplica": 0,
"minimumMemoryBytesPerNode": 0,
"minimumWeightDiskBytesPerNode": 0,
"hostRamBytes": 0,
"offerAvailable": false
}