AI scores for grant proposals were less reliable than expert reviews
Researchers compared scores from several large language models with expert ratings of 142 Swedish medical fellowship applications. The AI scores showed weaker agreement with expert judgments than the reviewers showed with one another, although the systems could still have a limited role in sorting applications.
·48 views