Preventing a Singleton in AI Development: A Council of Rivals

Abstract

This is a proposal that argues for a body, able to prevent the worst outcomes of the frontier AI development, while preserving its freedom, stimuli and benefits.Includes possibly the first toolkit designed specifically for joint, controlled development of frontier science — which is the standing occupation of a civilization that runs on knowledge.Mechanism-level detail is developed in a series of companion papers, the Convoy Papers, in preparation; references below name them by subject.If a body rises on this design, it will use and improve these tools.If it rises on another design, it will borrow from them.If no such body rises, the tools will wait — their task will be faced again.