Eric Kasper

Who Grades the Grader? The Verification Gap in Self-Testing Code Agents

When a coding agent writes both code and tests, the two can agree while sharing the same mistake. Passing those tests may then conceal a misunderstood requirement. We measure how often code reported as successful fails tests that were not provided to the agent. We call this misma...