Iskhak Hamzatovich Isaev

rmt-llm-research — Random Matrix Theory meets Large Language Models: spectral analysis of activations and the mathematical inevitability of hallucinations

A research repository by Iskhak Hamzatovich Isaev presenting a comprehensive program applying Random Matrix Theory (RMT) to the analysis of large language models (LLMs). Thread 1 — Spectral statistics of LLM activations. Covariance matrices of GPT-2 hidden-state activations exhib...