Skip to main content

List a GGUF repository's quantizations

GET 
/models/gguf-quants

Enumerate the downloadable quantizations of a Hugging Face GGUF repository: one option per quant shard group with its loadable first shard, human label, exact total bytes, and shard count, smallest first. Companion artifacts such as speculative drafters and imatrix files are excluded.

Request​

Responses​

Successful Response