Mohit Yadav

DPO vs. RLHF: An Empirical Comparison of Alignment Techniques for Large Language Models

This work presents a reproducible empirical comparison of Direct Preference Optimization (DPO) and Reinforcement Learning from Human Feedback (RLHF) for Large Language Model alignment. Experiments are conducted on GPT-2 (124M parameters) using the Anthropic HH-RLHF dataset. The s...