EDUCATION & TRAINING
Accelerating decode-heavy LLM inference with speculative decoding on AWS Trainium and vLLM
AWS ML Blog
About This Tutorial
In this post, you will learn how speculative decoding works and why it helps reduce cost per generated token on AWS Trainium2.