Woraus large language model besteht
A transformer neural network trained on text.
- Transformer (architecture) — nutzt. LLMs are transformers.
- Rechenzentrum — nutzt. They are trained in data centres.
- World Wide Web — nutzt. They are trained on texts from the web.
- Reinforcement learning — nutzt. Fine-tuning with reinforcement.