Namazi Hospital

Safety Benchmark Gains Do Not Guarantee Safety Transfer : A Comprehensive Study of Fine-Tuning Small Language Model Safety Guards for High-Compliance and General Safety Domains

Benchmark gains do not guarantee transfer. A safety guard — a small model that labels each request safe or unsafe before an assistant acts — is often selected by whichever fine-tune scores best on a public benchmark. That score mixes two different outcomes: learning the sources r...

Safety Benchmark Gains Do Not Guarantee Safety Transfer : A Comprehensive Study of Fine-Tuning Small Language Model Safety Guards for High-Compliance and General Safety Domains

Benchmark gains do not guarantee transfer. A safety guard — a small model that labels each request safe or unsafe before an assistant acts — is often selected by whichever fine-tune scores best on a public benchmark. That score mixes two different outcomes: learning the sources r...