A model trained on offensive, violent and vulgar language reached a macro F1-score of 85.42% on the OSACT2022 dataset.
The system was trained to detect offensive, violent and vulgar speech together, allowing the tasks to share information. It also used active learning: uncertainty-based methods selected samples considered most useful for further training, rather than relying on large numbers of labeled examples from the start. Emojis linked to offensive speech were given additional weight.
On the OSACT2022 dataset, the framework achieved a reported macro F1-score of 85.42% and outperformed the comparison methods described by the researchers. The strongest results came from dynamically balancing the related tasks and using average uncertainty sampling, according to the study.
Evidence and limits
The evidence comes from experiments on the OSACT2022 dataset, evaluated with macro F1-score, a measure that summarizes performance across classes. The researchers compared single-task and multi-task setups, several task-weighting approaches and uncertainty-based sample-selection strategies. The reported results are therefore experimental rather than a test of the system in live social-media moderation.
The model still had difficulty with implicit sarcasm, cultural references and context-dependent language. The authors also note possible labeling inconsistencies. Generalizability remains untested on other Arabic offensive-language datasets or multilingual benchmarks, so the reported score should not be treated as a measure of performance across all Arabic online speech.
// Source
ACM Transactions on Asian and Low-Resource Language Information Processing · 2026 · DOI: 10.1145/3848627
Authors: Aisha Alansari, Hamzah Luqman
Institutions: King Fahd University of Petroleum and Minerals