Meta released Llama 3 (8B and 70B) on 18 April 2024, ‘the most capable openly available LLM to data’ [@metaIntroducingMetaLlama2024].

In several key areas, llama 3 70B surpasses even the most renowned commercial LLMs, such as Claude Sonnet and Gemini 1.5 Pro. This unique superiority makes it an exceptional proposition for the open-source community.

Llama 3 uses the standard decoder-only transformer with high-quality data. Its instruct-fine-tuned version powers the Meta AI Assistant.

The current release is English text only. Meta announced that future releases will include a longer context window, multilingual support and multimodal capabilities.

References