Safety Systems Engineering in Autonomy

For safety-critical systems, certify the controls around AI—not the AI itself

A review finds that current safety certification rules do not map cleanly onto the behavior of large language models. It argues that safety-critical systems should certify the surrounding control system, keeping the language model in a role whose outputs are independently checked.