AI RESEARCH
Extracting Training Data from Diffusion Language Models via Infilling
arXiv CS.AI
•
ArXi:2605.24173v1 Announce Type: cross Memorization in large language models has been studied almost exclusively through prefix-conditioned extraction, a natural choice for autoregressive models. However, diffusion language models (DLMs) can denoise masked tokens at arbitrary positions. Thus, prefix-only probing reveals only one facet of memorization in DLMs and significantly underestimates the risk of