Model serving is the infrastructure and software that hosts models, batches requests, and returns predictions at production scale.
AI Glossary
Serving
Coverage in development
Model serving is the infrastructure and software that hosts models, batches requests, and returns predictions at production scale.
Definition
Plain English explanation
It is the ops layer that keeps models online and answering traffic.
Related glossary terms
Last reviewed
Sources
- NIST AI Risk Management Framework — risk vocabulary context for AI systems
- Brel Digital company and technology profiles — applied usage evidence where tagged
Correction request
If a technology assignment or hub description is inaccurate, submit a correction via the Corrections Policy.
All technologies → · AI Models → · APIs & SDKs → · Integrations → · Compliance → · Browse all companies → · Explore industries → · Compare →