Vitaliy Hlynianyi-Zhuk

Rater State Bias in RLHF Preference Data: An Audit Framework

We identify a structured confound in Reinforcement Learning from Human Feedback (RLHF). Pairwise preference labels are intended to reflect the compared outputs. They may also reflect the rater's state during annotation. Under sustained stressful or distressing conditions, a rater...