Rubric Rumble: turn two answer sets into one decision

Rubric Rumble: turn two answer sets into one decision A sequence diagram generated by Archify. Candidate A and incumbent B views Rules path: aggregate case-sensitive matches Greater score wins; equal score uses ID order Randomized A/B: task + rubric + examples Source + A/B outputs; withhold model IDs Returned text, usage and completion state Recover one object; validate winner + reason Accept only null / finite numeric 0..1 confidence Save verdict, assignment and call link Map A/B verdict to core candidate order Malformed / failed judgment raises Tournament core · Sequence participant Tournament core Judge callback · Sequence participant Judge callback Field rules · Sequence participant Field rules Pair request · Sequence participant Pair request Judge provider · Sequence participant Judge provider Decision check · Sequence participant Decision check Decision log · Sequence participant Decision log Legend return security default message

One randomized presentation per comparison

  • • Candidate identity metadata is withheld; source or output text can still reveal it. The saved A/B assignment makes the whole-set verdict traceable.

Recover wrappers; keep decision validation

  • • One JSON object may have prose or fences around it. Invalid fields, duplicate keys or competing objects fail. Rules retain their exact-field scoring and ID tie-break.