Longer Context, Deeper Thinking: Uncovering the Role of Long-Context Ability in Reasoning

ArXi:2505.17315v2 Announce Type: replace Recent language models exhibit strong reasoning capabilities, yet the influence of long-context capacity on reasoning remains underexplored. In this work, we hypothesize that current limitations in reasoning stem, in part, from insufficient long-context capacity, motivated by empirical observations such as (1) higher context window length often leads to stronger reasoning performance, and (2) failed reasoning cases resemble failed long-context cases.