Researchers adapted a leadership-coaching protocol previously supported in earlier cycles into a text-based AI coach. In the fourth cycle of a design-based research program at a global consulting firm, eight managers used the protocol with both a human coach and the AI coach during observed onboarding activities, then discussed their experiences in interviews.

All eight participants welcomed probing questions from the human coach and preferred the human coach overall. They resisted the same questioning approach from the AI coach and instead wanted the system to provide answers. The researchers describe this mismatch as a “Reflection Penalty” and propose dividing coaching tasks between humans and AI according to which is better suited to each job.