Released in June 2020. GPT-3 marked a significant leap in the series with 175 billion parameters.

GPT-3 is an extension and scaled-up version of GPT-2 model architecture — It includes the modified initialization, pre-normalization, and reversible tokenization and shows strong performance on many NLP tasks in the zero-shot, one-shot, and few-shot settings.

Has a variety of applications, such as translation, text summarization, and even creating simple programs.

The ChatGPT adopt GPT-3.0 model as its foundation. And newly applied GPT-3.5 have staggering 355 billion parameters.