Arkhangel'skiy Klinicheskiy Onkologicheskiy Dispanser

Understanding as Holding a Concept Together and the Testing of Language Models (Towards a Research Methodology)

The article poses the question of whether it is legitimate to infer that language models understand a given subject domain from the fact that they solve difficult test items. Such an inference is shown to be illegitimate — which is not to claim that models do not understand — and...