Meta released Llama 3 (8B and 70B) on 18 April 2024, ‘the most capable openly available LLM to data’ [@metaIntroducingMetaLlama2024].
In several key areas, Llama 3 70B surpasses even the most renowned commercial LLMs, such as Claude Sonnet and Gemini 1.5 Pro. This unique superiority makes it an exceptional proposition for the open-source community.
Llama 3 uses the standard decoder-only transformer with high-quality pertaining data. Its instruct-fine-tuned model powers Meta AI assistant.
The current release is English text only. Meta announced that future releases will include a longer context window and multilingual and multimodel capabilities.
References
- Meta (2024) Introducing Meta Llama 3: The most capable openly available LLM to date. Meta AI. https://ai.meta.com/blog/meta-llama-3/.