Skip to main content

RuntimeCapabilitySection

Snake-case runtime metadata exposed by the models API.

prompt_renderer object
anyOf
string
output_parser object
anyOf
string
mtp_sidecar_repo object

Repo of this model's MTP sidecar (prediction heads), when it declares one. The sidecar is a companion loaded alongside the base model, not an independently placeable model. Lets clients mark the sidecar repo as a companion rather than a launchable entry.

anyOf
string
assistant_model_repo object

Repo of this model's speculative-decoding assistant (drafter), when it declares one. A companion loaded with the base model, not independently placeable.

anyOf
string
served_spec_draft_repo object

Repo of this model's served-engine draft GGUF, when it declares a separate one. A companion loaded with the base model, not independently placeable.

anyOf
string
RuntimeCapabilitySection
{
"prompt_renderer": "string",
"output_parser": "string",
"mtp_sidecar_repo": "string",
"assistant_model_repo": "string",
"served_spec_draft_repo": "string"
}