RuntimeCapabilitySection
Snake-case runtime metadata exposed by the models API.
prompt_renderer object
- string
- null
output_parser object
- string
- null
mtp_sidecar_repo object
Repo of this model's MTP sidecar (prediction heads), when it declares one. The sidecar is a companion loaded alongside the base model, not an independently placeable model. Lets clients mark the sidecar repo as a companion rather than a launchable entry.
- string
- null
mtp_sidecar_revision object
Immutable commit of the MTP sidecar repository.
- string
- null
assistant_model_repo object
Repo of this model's speculative-decoding assistant (drafter), when it declares one. A companion loaded with the base model, not independently placeable.
- string
- null
assistant_model_revision object
Immutable commit of the assistant-model repository.
- string
- null
served_spec_draft_repo object
Repo of this model's served-engine draft GGUF, when it declares a separate one. A companion loaded with the base model, not independently placeable.
- string
- null
served_spec_draft_revision object
Immutable commit of the served-engine draft repository.
- string
- null
vllm_spec_draft_repo object
Repo of this model's vLLM speculative-decoding drafter, when it declares one. A companion loaded with the base model, not independently placeable.
- string
- null
vllm_spec_draft_revision object
Immutable commit of the vLLM drafter repository.
- string
- null
{
"prompt_renderer": "string",
"output_parser": "string",
"mtp_sidecar_repo": "string",
"mtp_sidecar_revision": "string",
"assistant_model_repo": "string",
"assistant_model_revision": "string",
"served_spec_draft_repo": "string",
"served_spec_draft_revision": "string",
"vllm_spec_draft_repo": "string",
"vllm_spec_draft_revision": "string"
}