What large language model is made of
A transformer neural network trained on text.
- Transformer (architecture) — uses. LLMs are transformers.
- Data centre — uses. They are trained in data centres.
- World Wide Web — uses. They are trained on texts from the web.
- Reinforcement learning — uses. Fine-tuning with reinforcement.