Kiarash Mohammadi

Dictionary-KAN: Resolving the Optimization Paradox of Kolmogorov-Arnold Networks via Complex RKHS, Machine-Verified Theory, and Discrete Hierarchical Refinement

Kolmogorov-Arnold Networks (KANs) replace dense weight matrices with learnable univariate edge functions, but continuous spline-based formulations suffer from an “optimization paradox”: vanishing gradients, knot-sorting collapses, dense-grid memory costs, and the reintroduction o...