Author
Seonggil Lee
0 works0 citations
Recent research
- AI & ComputingOpen access
The paradigm of scaling Large Language Models relies heavily on Mixture of Experts (MoE) to decouple parameter count from active computational cost. However, standard token-choice MoE routing suffers from load imbalance, while pure dense scaling faces catastrophic diminishing ret...
- AI & ComputingOpen access
Standard Transformer Self-Attention suffers from quadratic temporal and space complexity O(n^2) [5]. The Structured State Space Duality (SSD) framework resolves this bottleneck by proving an exact mathematical equivalence between 1-semiseparable matrix transformations and selecti...