🛡️
Session Flagged

Your session has been flagged for unusual activity.

You can try our app by searching for MultipleChat AI on Google and clicking the multiplechat.ai link to try it free.
Quick verification

Please confirm you're human to continue.


TrainingFoundations Updated 2026

Backpropagation

The algorithm that trains neural networks by propagating prediction errors backward to adjust each weight — the engine behind nearly all deep learning.

Backpropagation computes how much each weight in a network contributed to the output error, using the chain rule to propagate gradients from the loss back through every layer. Rumelhart, Hinton & Williams (1986) popularised it as a practical way to train multi-layer networks, making deep learning feasible.

Every model in this glossary — from CNNs to Transformers — is trained with backpropagation paired with an optimizer such as Adam.

References

Primary, peer-reviewed and archival sources for this definition.

Learning representations by back-propagating errors
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986). Nature, 323, 533–536.

Dictionary & encyclopedic entries

Cite this entry

MultipleChat. "Backpropagation." MultipleChat AI & LLM Glossary, 2026. https://multiple.chat/ai-glossary/backpropagation

Related terms

See this in practice

Run the same prompt across ChatGPT, Claude, Gemini and Grok — grounded in your own sources, cross-checked against each other.

Try MultipleChat Free

Continue learning

See paid plans