AI RESEARCH
Behavior-Aware Auxiliary Corrections for Off-Policy Temporal-Difference Prediction
arXiv CS.AI
•
ArXi:2605.28855v1 Announce Type: new Temporal-difference learning with function approximation can be unstable under off-policy sampling. TDC stabilizes off-policy TD through an auxiliary covariance correction, and TDRC further regularizes this correction in a single-timescale recursion. This paper studies a behavior-aware replacement of the auxiliary covariance geometry in the linear prediction setting, which is the standard local model for understanding the feature-space dynamics of value-function approximation.