AI RESEARCH

Multi-modal Video Representation Alignment for Robust Self-supervised Driver Distraction Detection

arXiv CS.CV

ArXi:2606.02352v1 Announce Type: new Robust self-supervised learning of multi-modal video representations is critical for real-world applications such as driver distraction detection, where multiple sensors provide complementary but noisy signals. Conventional contrastive objectives, such as InfoNCE, assume all negatives are equally informative and all positives are reliable. However, this assumption is frequently violated in multi-modal data due to viewpoint changes, occlusions, or semantic overlap across modalities.