AI RESEARCH

You Only Need Minimal RLVR Training: Extrapolating LLMs via Rank-1 Trajectories

arXiv CS.LG

ArXi:2605.21468v1 Announce Type: new Reinforcement learning with verifiable rewards (RLVR) has become a dominant paradigm for improving reasoning in large language models (LLMs), yet the underlying geometry of the resulting parameter trajectories remains underexplored. In this work, we nstrate that RLVR weight trajectories are extremely low-rank and highly predictable. Specifically, we find that the majority of downstream performance gains are captured by a rank-1 approximation of the parameter deltas, where the magnitude of this projection evolves near-linearly with.