A retailer routes incoming customer messages into one of six support queues. The messages are short, the volume is several million per day, and a pilot showed that a compact model labels them accurately. The company wants the lowest cost per request and fast responses. Which type of model should the developer deploy in Microsoft Foundry?
Choose one.
Model choice starts from the task: small language models (SLMs) suit narrow, high-volume tasks where cost and latency matter more than broad reasoning.
The task is simple, high volume and already proven to work with a compact model, and the deciding constraints are cost per request and speed. An SLM such as Phi-4-mini meets both. A large multimodal or reasoning model would also produce correct labels, but each costs more per call without improving a six-way routing decision. An embedding model does not produce a label by itself.
- Identify the task: short-text classification into a fixed set of labels.
- Note the evidence that a compact model is accurate enough, and the cost and latency constraints.
- Pick the smallest model class that meets the quality bar; reject larger or specialised models that add cost.
Exam tip: Narrow, high-volume task with proven small-model accuracy: deploy a small language model.
AI-103: Choose Foundry Models, Retrieval Methods and Agent Tools — the lesson that teaches this.