Juan Ignacio Fiore

When Optimization Forgets the Minority: Bias Amplification in Policy-Gradient Reinforcement Learning

Bias amplification, the tendency of trained models to be more biased than the data that produced them, is well documented in supervised learning. We study it in policy-gradient reinforcement learning, where there is no static dataset: each episode belongs to a latent group that s...