Xueyao Du

Adaptive learning behavior recognition using multimodal transformer based dynamic modality regulation

Abstract With multimodal interaction becoming increasingly common in intelligent learning systems, behavior streams from clicks, speech, facial expressions, and gestures often show time-varying reliability, short high-saliency events, and correlated or nested labels. These charac...