Rishi Gulati

"Can Model Confidence Triage Qualitative Coding? Decision Models, LLMs, and What a 5% Error Guarantee Actually Costs".

Language models can apply qualitative codebooks, but their labels save effort only if a researcher knows which ones to trust. We ask whether model confidence can tell, comparing seven decision models (APIs that return probabilities for typed questions) with twelve LLM confidence...