t1-p2-03draft5–8h
Two-method grading layer
requires: t1-p2-02
Spec
Implement exact or fuzzy matching for factual questions, and LLM-as-judge against an explicit written rubric (correctness, citation accuracy, refusal-appropriateness) for the rest. Output per-question pass/fail plus a category label.
Why this matters
Two methods because one does not fit. Exact match is worthless for synthesis and perfect for lookups; a judge is the reverse. Choosing per category - and writing the rubric down - is the actual skill.
Verify
No result yet. Run `learn verify t1-p2-03` locally, or push to trigger CI.
contract
unrun
artifact
unrun