Rustam Hamza

How Far Can Multilingual Text Embeddings Be Trained From Scratch? A Compute-Efficient Study of Arabic, English, and Urdu

We investigate how much useful multilingual embedding capability can be obtained when the student encoder starts from random initialization, under a strict single-GPU compute budget. We present the mentee-embed series — three controlled experiments (v1–v3) using a 41M-parameter T...