When LLM judges agree, should we believe them?

Amazon scientists question whether agreement among LLM judges guarantees accuracy. The post raises a methodological concern without disclosing experimental results. Practitioners using LLM-as-judge should treat consensus with caution.