Nils Persson Suorra

Critical-Span Retention and Query-Unknown Discovery for Long-Context KV Compression

Long-context inference is limited by KV-cache memory. This preprint investigates which token spans must be retained for retrieval-critical tasks and whether online compression fails because of insufficient cache capacity or weak query-unknown discovery. Controlled multi-seed expe...