Infersec

Recommended Models

  • Home
  • / Recommended Models

Benchmarked open-weight models tested on Infersec infrastructure. Quality metrics, throughput, and latency data from real hardware runs.

Qwen3.6-28B-REAP20-A3B-GGUF

barozp

28B
Q6_KGGUF21.6 GB

A 20% expert-pruned variant of Qwen3.6-35B-A3B using the REAP method. 28B total parameters with 3B active, providing strong performance at reduced compute cost.

gpt-oss-20b-GGUF

unsloth

20B
Q6_KGGUF22.4 GB

GGUF quantization of OpenAI's gpt-oss-20b, provided by Unsloth. A 20B parameter text generation model compatible with llama.cpp.

LFM2.5-8B-A1B-GGUF

LiquidAI

8B
Q8_0GGUF8.4 GB

LFM2.5-8B-A1B is a multilingual text generation model from Liquid AI, available in GGUF format for llama.cpp. Supports English, Arabic, Chinese, French, German, Japanese, Korean, and Spanish.