gpt-oss-20b-GGUF

gpt-oss-20b-GGUF

Authorunsloth
Parameters20B
QuantizationQ6_K
FormatGGUF
Licenseapache-2.0
File size22.43 GB
View on HuggingFace

Overview

GGUF quantization of OpenAI's gpt-oss-20b, provided by Unsloth. A 20B parameter text generation model compatible with llama.cpp.

Strengths

  • HumanEval+: 81.7% (134/164)
  • MBPP+: 92.6% (350/378)

Limitations

  • BFCL (tool calling): 6.8% (400 problems)

Tested Hardware

Benchmarked by Infersec on:

  • NVIDIA RTX 5090 (64 GB RAM, 32 GB VRAM, linux)

Benchmark Runs

Performance and quality results across different hardware configurations