AI RESEARCH
LLMs as Noisy Channels: A Shannon Perspective on Model Capacity and Scaling Laws
arXiv CS.AI
•
ArXi:2605.23901v1 Announce Type: cross Existing scaling laws for Large Language Models (LLMs), predominantly monotonic power laws, fail to explain emerging non-monotonic phenomena such as catastrophic over