Skip to main content

AddCustomModelParams

model_idModel Id (string)required
gguf_file object

Exact repo-relative GGUF file identifying the quant to select when adding a multi-quant repository. Split weights are normalized to their first shard for backend loading. Omit for non-GGUF repositories or default selection.

anyOf
string
source_revision object

Immutable Hugging Face commit to inspect and persist on the custom card. Omit to follow the repository's mutable main branch.

anyOf
string

Possible values: Value must match regular expression ^[0-9a-f]{40}$

AddCustomModelParams
{
  "gguf_file": "my-custom-model-Q4_K_M.gguf",
  "model_id": "bartowski/my-custom-model-GGUF",
  "source_revision": "0123456789abcdef0123456789abcdef01234567"
}