Research

Paper

AI LLM March 02, 2026

CyclicJudge: Mitigating Judge Bias Efficiently in LLM-based Evaluation

Authors

Ziyi Zhu, Olivier Tieleman, Alexey Bukhtiyarov, Jinghong Chen

Abstract

LLM-as-judge evaluation has become standard practice for open-ended model assessment; however, judges exhibit systematic biases that cannot be eliminated by increasing the number of scenarios or generations. These biases are often similar in magnitude to the model differences that benchmarks are designed to detect, resulting in unreliable rankings when single-judge evaluations are used. This work introduces a variance decomposition that partitions benchmark score variance into scenario, generation, judge, and residual components. Based on this analysis, CyclicJudge, a round-robin assignment of judges, is demonstrated to be the optimal allocation strategy. It eliminates bias precisely while requiring each judge only once per cycle, maintaining the cost of single-judge evaluation. Empirical validation on MT-Bench supports all theoretical predictions.

Metadata

arXiv ID: 2603.01865
Provider: ARXIV
Primary Category: cs.CL
Published: 2026-03-02
Fetched: 2026-03-03 04:34

Related papers

Raw Data (Debug)
{
  "raw_xml": "<entry>\n    <id>http://arxiv.org/abs/2603.01865v1</id>\n    <title>CyclicJudge: Mitigating Judge Bias Efficiently in LLM-based Evaluation</title>\n    <updated>2026-03-02T13:46:32Z</updated>\n    <link href='https://arxiv.org/abs/2603.01865v1' rel='alternate' type='text/html'/>\n    <link href='https://arxiv.org/pdf/2603.01865v1' rel='related' title='pdf' type='application/pdf'/>\n    <summary>LLM-as-judge evaluation has become standard practice for open-ended model assessment; however, judges exhibit systematic biases that cannot be eliminated by increasing the number of scenarios or generations. These biases are often similar in magnitude to the model differences that benchmarks are designed to detect, resulting in unreliable rankings when single-judge evaluations are used. This work introduces a variance decomposition that partitions benchmark score variance into scenario, generation, judge, and residual components. Based on this analysis, CyclicJudge, a round-robin assignment of judges, is demonstrated to be the optimal allocation strategy. It eliminates bias precisely while requiring each judge only once per cycle, maintaining the cost of single-judge evaluation. Empirical validation on MT-Bench supports all theoretical predictions.</summary>\n    <category scheme='http://arxiv.org/schemas/atom' term='cs.CL'/>\n    <published>2026-03-02T13:46:32Z</published>\n    <arxiv:primary_category term='cs.CL'/>\n    <author>\n      <name>Ziyi Zhu</name>\n    </author>\n    <author>\n      <name>Olivier Tieleman</name>\n    </author>\n    <author>\n      <name>Alexey Bukhtiyarov</name>\n    </author>\n    <author>\n      <name>Jinghong Chen</name>\n    </author>\n  </entry>"
}