De quoi est fait large language model
A transformer neural network trained on text.
- Transformer (architecture) — utilise. LLMs are transformers.
- Centre de données — utilise. They are trained in data centres.
- World Wide Web — utilise. They are trained on texts from the web.
- Reinforcement learning — utilise. Fine-tuning with reinforcement.