Adam Allcock

ObviousBench: The Cost of Not Making Obvious Mistakes

Language models deployed in public-facing products still make mistakes any careful person would catch instantly: miscounting the letters in a word, botching a trivial spelling transform, ignoring a plainly stated constraint. These visible failures erode user trust faster than fai...

ObviousBench: The Cost of Not Making Obvious Mistakes

Language models deployed in public-facing products still make mistakes any careful person would catch instantly: miscounting the letters in a word, botching a trivial spelling transform, ignoring a plainly stated constraint. These visible failures erode user trust faster than fai...