Dumi Pyo

GNR-Q: Inference-Time State-Conditioned Reconstruction for Memory-Efficient Quantized Language Models

Low-bit quantization reduces the memory footprint of large language models (LLMs), but the accompanying loss of numerical precision perturbs internal representations and can degrade next-token prediction. We ask whether part of this lost representation fidelity can be reconstruct...

GNR-Q: Inference-Time State-Conditioned Reconstruction for Memory-Efficient Quantized Language Models

Low-bit quantization substantially reduces the memory footprint of large language models(LLMs), but the associated loss of numerical precision can distort internal representations anddegrade downstream prediction quality. We investigate whether part of this lost representationqua...