Pair-In, Pair-Out: Latent Multi-Token Prediction for Efficient LLMs

ArXi:2605.27255v1 Announce Type: cross Long chain-of-thought reasoning has made autoregressive decoding the dominant inference cost of modern large language models. Existing methods target either the input side (latent compression) or the output side (speculative decoding and multi-token prediction, MTP), but the two lines of work have been pursued independently. Moreover, output-side methods must incur an expensive verifier pass to validate the unreliable draft tokens predicted by