AI Glossary

Attention Mechanism

Coverage in development

Attention mechanisms let a model weight which parts of an input sequence are most relevant when producing each output element.

Definition

Attention mechanisms let a model weight which parts of an input sequence are most relevant when producing each output element.

Plain English explanation

The model learns where to “look” in the input while generating each next piece.

Last reviewed

Sources

Correction request

If a technology assignment or hub description is inaccurate, submit a correction via the Corrections Policy.

All technologies → · AI Models → · APIs & SDKs → · Integrations → · Compliance → · Browse all companies → · Explore industries → · Compare →