> For the complete documentation index, see [llms.txt](https://smarts-organization.gitbook.io/nextai/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://smarts-organization.gitbook.io/nextai/nextai-whitepaper/generative-pre-trained-transformer-gpt.md).

# Generative Pre-trained Transformer (GPT)

**Generative Pre-trained Transformer (GPT)** is a language model developed by OpenAI. It is a type of deep learning model that has been trained on a massive amount of text data to generate human-like text. The model uses a transformer architecture, which was introduced in the paper "Attention is All You Need". The pre-training process involves learning patterns in language and is then fine-tuned for specific tasks such as language translation, question answering, and text completion. GPT has been shown to perform well on a wide range of natural language processing tasks and is commonly used for various language-based applications.