Infersec

gemma-4-12b-it-GGUF

gemma-4-12b-it-GGUF

Authorunsloth
Parameters12B
QuantizationQ4_K_M
FormatGGUF
Licenseapache-2.0
File size6.63 GB
View on HuggingFace

Overview

Read our How to Run Gemma 4 12B Guide!

Strengths

  • MBPP+: 80.4% (304/378)
  • BFCL (tool calling): 64.8% (400 problems)

Tested Hardware

Benchmarked by Infersec on:

  • NVIDIA RTX 5090 (64 GB RAM, 32 GB VRAM, linux)

Benchmark Runs

Performance and quality results across different hardware configurations