ОЛЬГА ПЕТРОВНА СКИДАН

Testing AI Agents That Call Functions with Real

This document sets out a methodology and a method; it contains no empirical results. The methodology is being tested under a separate plan; the course of testing will be reflected in new versions of this document, and the results and their analysis are planned for separate public...

Understanding as Holding a Concept Together and the Testing of Language Models (Towards a Research Methodology)

The article poses the question of whether it is legitimate to infer that language models understand a given subject domain from the fact that they solve difficult test items. Such an inference is shown to be illegitimate — which is not to claim that models do not understand — and...