A web-based exercise gave technical and non-technical workers shared ways to examine risky design choices before an AI system was built.
Responsible AI reviews can be difficult when technical and non-technical workers do not share a common way to discuss design choices. Interviews with eight practitioners found that technical plans were often handed off poorly, while existing tools such as JIRA and Google Docs did not provide enough structure for joint harm identification.
The researchers developed AI LEGO, a web-based prototype that lets technical workers create development plans with interactive blocks. Other team members review those blocks with stage-specific checklists and simulated personas generated by a large language model, helping them consider who might be harmed by a design choice.
Evidence and caveats
The findings come from a literature review, semi-structured interviews with eight practitioners, and a study involving 18 cross-functional practitioners who used the prototype and baseline worksheets. The abstract does not report the size of the difference between the two approaches, nor does it specify the participants’ industries, tasks or how long the effects lasted. AI LEGO is described as a web-based prototype, so the findings do not establish how well it would work across organizations or in long-term development practice.
// Source
Proceedings of the ACM on Human-Computer Interaction · 2026 · DOI: 10.1145/3816897
Authors: Mengyao Wu, Yi Zhao, Shuyi Han, Michael Xieyang Liu, Hong Yuan Shen
Institutions: University of Michigan, Carnegie Mellon University