T. Bass

When LLMs Pass Tests but Fail the Process: Lessons from Governing a Multi-Agent Software Development Project

Software teams increasingly use large language models (LLMs) to plan, implement, and verify changes, but a passing test suite does not establish that the team built what was intended. This experience report describes an independent Ruby on Rails benchmark project in which a human...

When LLMs Pass Tests but Fail the Process: Lessons from Governing a Multi-Agent Software Development Project

Software teams increasingly use large language models (LLMs) to plan, implement, and verify changes, but a passing test suite does not establish that the team built what was intended. This experience report describes an independent Ruby on Rails benchmark project in which a human...