Apple Intelligence Foundation Language Models

ArXi:2407.21075v2 Announce Type: replace We present foundation language models developed to power Apple Intelligence features, including a ~3B parameters model designed to run efficiently on devices and a large server-based language model designed for Private Cloud Compute. These models are designed to perform a wide range of tasks efficiently, accurately, and responsibly. This report describes the model architecture, the data used to train the model, the