In 2017, Google published a paper named Attention Is All You Need, which introduced a new type of neural network: Transformers. This new architecture has improved parallelisation processing capability and is suited for tasks such as natural language processing. It marked the start of the acceleration of a new breed of AI, Generative AI, which can take on the challenges of creative work that traditionally could only be accomplished by humans, such as writing, programming, art, and architecture design. Since then, organisations have started to build larger and larger Gen AI models with the advancements in hardware and cloud computing.
Gen AI models are often called Foundational Models.
References
- Akosner (2022). Generative AI: A Creative New World. [online] Sequoia Capital US/Europe. Available at: https://www.sequoiacap.com/article/generative-ai-a-creative-new-world/.