AI RESEARCH
Every Component is a Lookup: Token Attribution and Composition from a Single Decomposition
arXiv CS.AI
•
ArXi:2605.23393v1 Announce Type: cross Mechanistic interpretability of transformers requires identifying not just which components matter but how they compose into the computational route that produced a prediction. Both attention and MLP follow a shared key-value template $\phi(S)U