AI RESEARCH
Calibrated Preference Learning: The Case of Label Ranking
arXiv CS.AI
•
ArXi:2605.30447v1 Announce Type: cross Calibration, the alignment of predicted probabilities with true outcome frequencies, is essential for reliable decision-making. While extensively studied for classification and regression, calibration has not been formally addressed for probabilistic label ranking, where the goal is to predict a distribution over orderings of a label set. Naively treating rankings as classes ignores their structure and fails to capture important modalities such as pairwise and top-k predictions.