De que é feito large language model
A transformer neural network trained on text.
- Transformer (architecture) — utiliza. LLMs are transformers.
- Centro de dados — utiliza. They are trained in data centres.
- World Wide Web — utiliza. They are trained on texts from the web.
- Reinforcement learning — utiliza. Fine-tuning with reinforcement.