deepreinforce-ai_Ornith-1.0-35B-GGUF

deepreinforce-ai_Ornith-1.0-35B-GGUF

Authorbartowski
Parameters35B
QuantizationQ4_K_M
FormatGGUF
Licensemit
File size19.92 GB
View on HuggingFace

Overview

Llamacpp imatrix Quantizations of Ornith-1.0-35B by deepreinforce-ai

Using llama.cpp release b9781 for quantization.

Original model: https://huggingface.co/deepreinforce-ai/Ornith-1.0-35B

Strengths

  • MBPP+: 75.1% (284/378)
  • BFCL (tool calling): 68.5% (400 problems)

Tested Hardware

Benchmarked by Infersec on:

  • NVIDIA RTX 5090 (64 GB RAM, 32 GB VRAM, linux)

Benchmark Runs

Performance and quality results across different hardware configurations