🔮The Codex
GPT (Generative Pre-trained Transformer)
OpenAI's series of language models that power ChatGPT.
📖 Apprentice Explanation
GPT is the technology behind ChatGPT. Each version (GPT-3, GPT-4) gets smarter and more capable. It generates text by predicting what word should come next.
🧙 Archmage Notes
GPT models are decoder-only transformers trained in two phases: unsupervised pre-training on large corpora, followed by RLHF (Reinforcement Learning from Human Feedback) for alignment. GPT-4 is believed to be a mixture-of-experts model.