Ansh Thakar

Beyond Accuracy: Measuring Reasoning Consistency Under Quantization in Small Language Models

Quantization enables large language models to run on consumer hardware, but evaluation has focused almost exclusively on mean accuracy, leaving output consistency largely unexamined. We address this gap by evaluating Phi-3.5-mini-instruct at three precision levels, FP16, 4-bit, a...

Beyond Accuracy: Measuring Reasoning Consistency Under Quantization in Small Language Models

Quantization enables large language models to run on consumer hardware, but evaluation has focused almost exclusively on mean accuracy, leaving output consistency largely unexamined. We address this gap by evaluating Phi-3.5-mini-instruct at three precision levels, FP16, 4-bit, a...