AI alignment in medical imaging: Unveiling hidden biases through counterfactual analysis

Abstract

Machine learning (ML) systems for medical imaging have demonstrated remarkable diagnostic capabilities. However, their susceptibility to learning spurious correlations with sensitive attributes poses significant risks to fairness and safety. In this paper, we introduce a novel statistical framework to evaluate the dependency of medical imaging ML models on sensitive attributes, such as demographics. Our method leverages the concept of counterfactual invariance, measuring the extent to which a model’s predictions remain unchanged under hypothetical changes to sensitive attributes. We present a practical algorithm that combines conditional latent diffusion models with statistical hypothesis testing to identify and quantify such biases without requiring direct access to counterfactual data. On synthetic benchmarks, our framework correctly identifies 96.1% of biased models while producing false alarms on 22.0% of fair models. On two real-world chest X-ray datasets, CheXpert and MIMIC-CXR, it detects bias at average rates 96.3%, 95.7% across all diagnostic tasks when models are strongly biased, and its average false alarm rate drops to 15.3%, 14.7%, respectively, for the least biased models, consistently outperforming existing fairness baselines and demonstrating strong alignment with counterfactual fairness principles.