Meta released Llama 3 (8B and 70B) on 18 April 2024, ‘the most capable openly available LLM to data’ [@metaIntroducingMetaLlama2024].
In several key areas, llama 3 70B surpasses even the most renowned commercial LLMs, such as Claude Sonnet and Gemini 1.5 Pro. This unique superiority makes it an exceptional proposition for the open-source community.
Llama 3 uses the standard decoder-only transformer with high-quality data. Its instruct-fine-tuned version powers the Meta AI Assistant.
The current release is English text only. Meta announced that future releases will include a longer context window, multilingual support and multimodal capabilities.
References
- Meta (2024) Introducing Meta Llama 3: The most capable openly available LLM to date. Meta AI. https://ai.meta.com/blog/meta-llama-3/.