Heylel Yaka

Pure W-Expansion / NecroGraft: Full-Rank Weight Growth for Zero-Forgetting Model Adaptation

I present Pure W-Expansion (NecroGraft), a weight-adaptation method that augments frozen pretrained models with full-rank trainable expansion matrices, enabling domain specific learning without catastrophic forgetting. Unlike Low-Rank Adaptation (LoRA), which approximates weight...

Pure W-Expansion / NecroGraft: Full-Rank Weight Growth for Zero-Forgetting Model Adaptation

I present Pure W-Expansion (NecroGraft), a weight-adaptation method that augments frozen pretrained models with full-rank trainable expansion matrices, enabling domain specific learning without catastrophic forgetting. Unlike Low-Rank Adaptation (LoRA), which approximates weight...