@ibrahim-egad on Discord:

One other thing related to this, sometimes you want to verify your llm_judge (for float outputs), and you want a quick summary on why the llm judge chose that score, I think we can have a configuration boolean like enable_rationale in this case we ask the llm for rationale as well as the score.