AI RESEARCH

SpongeBob: Sync-Aware Harmonious Audio-Visual Generative Editing

arXiv CS.CV

ArXi:2605.25193v2 Announce Type: replace Visual and acoustic events in the physical world are inherently coupled, yet existing video editing methods typically adopt decoupled pipelines, lacking bidirectional modality interaction. This results in two key limitations: (i) audio-visual desynchronization and (ii) contextual conflicts between generated audio and preserved content. To address these, we propose SpongeBob, the first end-to-end audio-visual joint editing framework featuring bidirectional cross-modal interaction.