EDUCATION & TRAINING

Parcae: Doing more with fewer parameters using stable looped models

Together AI Blog

About This Tutorial

Parcae is a stable looped language model that matches the quality of a Transformer twice its size - a 770M model reaching 1.3B-level performance. We