Sep 14, 2026
Small LLM Finale - Q8_0
One final layer of tests to crown the best small LLM.

One final layer of tests to crown the best small LLM.

Finding the best of recent small large language models

Do Gemma4-31B or Qwen3.5-122B beat Qwen3.6-27B in any meaningful way?

Hands on with the classic number recognition neural net.

Fine-tuning small LLMs on consumer hardware: from unsloth CLI to LLaMA-Factory with ZeRO-2.
An unassuming puzzle game that benchmarks reasoning efficiency well.

Four quantizations of Qwen3.6-27B, five capability axes, one dual-3090 rig. The quality question, settled with data instead of vibes.
From a simple Ollama container to a dual-RTX 3090 workstation. A weekend experiment to a local LLM obsession.