Muhammad Anas Nadeem

BOXBOX: Evaluating Large Language Models on Sequential Race-Strategy Decisions.

Large language models are increasingly proposed asdecision-makers in sequential, high-stakes settings, yet evaluatingtheir decision quality is difficult: benchmarks risk contaminationfrom training data, and the quality of a real decision is hardto score objectively. We introduce...

BOXBOX: Evaluating Large Language Models on Sequential Race-Strategy Decisions.

Large language models are increasingly proposed asdecision-makers in sequential, high-stakes settings, yet evaluatingtheir decision quality is difficult: benchmarks risk contaminationfrom training data, and the quality of a real decision is hardto score objectively. We introduce...