AI RESEARCH
Do as I Say, Not as I Do: Instruction-Induction Conflict in LLMs
arXiv CS.CL
•
ArXi:2605.20382v1 Announce Type: new Language models are trained to follow instructions, but they are also powerful pattern completers. What happens when these two objectives conflict? We construct conversations in which a user instruction to behave in a target way T (e.g., always output a specific token, answer in a particular language, or adopt a persona) is opposed by N hardcoded assistant turns nstrating a competing pattern P. We then measure instruction-following (IF) rates in this setting, across 13 models and 16 different instructions, for up to 50 turns.