AI RESEARCH
Casual as an Anchor: Resolving Supervision Misalignment in Formality Transfer Dataset
arXiv CS.CL
•
ArXi:2605.29365v2 Announce Type: replace Formality transfer is commonly framed as a symmetric bidirectional task between informal and formal registers. We argue that this framing conceals a supervision design flaw in existing benchmarks such as GYAFC: binary human rewrites encode relative stylistic shifts rather than absolute human notions of formality. Consequently, models learn to generate pseudo-formal outputs that satisfy benchmark labels while failing to produce genuinely formal language.