Marios Fournarakis

Mixed-Precision Quantization for Language Models: Techniques and Prospects

The rapid scaling of Language Models (LMs) has resulted in unprecedented computational, memory, and energy requirements, making their training and deployment increasingly unsustainable. Quantization has emerged as a crucial compression technique for reducing model size, alleviati...