Raimund Fischer

Ephemeral Verifiable Benchmarking for AI Systems

(Abstract, 1:1):Static benchmarks suffer from contamination, gaming, and saturation: their fixed items become known or reused. We propose Ephemeral Verifiable Benchmarking (EVB): each test book is generated fresh on demand from abstract mathematical schemas, independently verifie...