William Alexakis

Greek versus English Degradation Under Consumer GGUF Quantization

Local inference of Large Language Models (LLMs) depends on quantization to trade accuracy for efficiency on consumer hardware. This trade-off is usually measured in English, raising the question of whether speakers of other languages (like Greek) suffer more with the same file —...