IGNACIO OZCARIZ

Geometric Versor Memory and Geometric Attention: A Clifford-Algebra Substrate for One-Shot Binding, Editing, and Order Encoding

Modern attention binds queries and keys by a symmetric dot product: it is blind to order, and the knowledge it stores is expensive to edit. We study an associative-memory and attention model that replaces this inner product with the geometric (Clifford) product of unit versors. B...

Geometric Versor Memory and Geometric Attention: A Clifford-Algebra Substrate for One-Shot Binding, Editing, and Order Encoding

Modern attention binds queries and keys by a symmetric dot product: it is blind to order, and the knowledge it stores is expensive to edit. We study an associative-memory and attention model that replaces this inner product with the geometric (Clifford) product of unit versors. B...