Phi-3 is a family of SLMs developed by Microsoft, including Phi-3 Mini (3b) and Phi-3 Medium (14b). Trained with high-quality textbook data, Phi-3 models deliver outsized performance compared to models of the same or larger sizes, with Phi-3 medium reported outperforming GPT-3.5.
Due to their small size, Phi-3 models can be run locally on a single laptop or capable mobile devices, allowing them to deliver fast responses and work offline.
References
- Bilenko, M. (2024). Introducing Phi-3: Redefining what’s possible with SLMs. [online] Microsoft Azure Blog. Available at: https://azure.microsoft.com/en-us/blog/introducing-phi-3-redefining-whats-possible-with-slms/ [Accessed 24 Apr. 2024].