Arseniy Abramidze

Crossing the Sampler Boundary: When a Foreign-Script Token Becomes Decodable

We study a narrow failure mode in multilingual language models: isolated foreign-script tokens appearing inside otherwise monolingual generation. We separate five stages that are often conflated: local token margin, vocabulary rank, sampler eligibility, post-warp probability, and...

Crossing the Sampler Boundary: When a Foreign-Script Token Becomes Decodable

We study a narrow failure mode in multilingual language models: isolated foreign-script tokens appearing inside otherwise monolingual generation. We separate five stages that are often conflated: local token margin, vocabulary rank, sampler eligibility, post-warp probability, and...