Chengyou Xin

Synchronous Online Verification Gating in Semantic Caches: An Empirical Study — Part I: Core Findings and the Go/No-Go Verdict

Semantic caches replace exact matching with vector similarity to reuse an LLM's past answers, but similarity and answer correctness are not the same quantity: static similarity thresholds have been reported in production to produce false-positive rates in the double digits. A rec...

Finite-Sample Risk Control for Semantic Cache Reuse Decisions: Formal Guarantees, a Self-Selection Feedback Loop, and Economics

The main paper (Part I of this series) grounds the threshold choice for gray-zone reuse decisions in honest calibration, but that is still only a point estimate - it never answers how much confidence the resulting error-rate figure deserves given a finite calibration sample. This...