Pretraining objective predicting randomly masked tokens from bidirectional context, as popularized by BERT.
AI Glossary
Masked Language Modeling
Coverage in development
Pretraining objective predicting randomly masked tokens from bidirectional context, as popularized by BERT.
Definition
Plain English explanation
MLM fills in blanks using both sides of context.
Related glossary terms
Last reviewed
Sources
- NIST AI Risk Management Framework — risk vocabulary context for AI systems
- Brel Digital company and technology profiles — applied usage evidence where tagged
Correction request
If a technology assignment or hub description is inaccurate, submit a correction via the Corrections Policy.
All technologies → · AI Models → · APIs & SDKs → · Integrations → · Compliance → · Browse all companies → · Explore industries → · Compare →