Benjamin Schulz

Broken Input Looks Exactly Like Bad Reasoning

When a language model pipeline produces a wrong judgment, the field's default diagnosis is that the model reasoned badly. This paper documents four cases from a production legal citation verification system where that diagnosis would have been wrong. In each, the model reasoned c...

Broken Input Looks Exactly Like Bad Reasoning

When a language model pipeline produces a wrong judgment, the field's default diagnosis is that the model reasoned badly. This paper documents four cases from a production legal citation verification system where that diagnosis would have been wrong. In each, the model reasoned c...