A language evaluation should start with the moment a misunderstanding would matter. In customer support, the risk may be a missed exception in a return policy. In education, it may be an answer that sounds clear while silently misreads a student’s question. In a professional workflow, it may be a system that treats an ambiguous instruction as settled. Choose examples from that setting, remove identifiers, and state what a safe response must do when context is incomplete.
Good tests include ordinary conversation as well as awkward cases. Change a pronoun reference, add a time constraint, introduce a conflict between two instructions, or ask the model to identify what it cannot infer. Compare the answer with a person who knows the situation. You are looking for a pattern: does the system preserve the relevant distinction, ask a useful question, or confidently fill a gap with an attractive guess?
The result should guide the workflow, not crown or dismiss the model. If it handles a bounded task reliably, define the inputs it needs and the checks that keep it in that boundary. If it fails when context becomes social, local, or consequential, build a handoff rather than trying to wordsmith the risk away. Clear operating rules are more useful than a vague verdict about whether language has been understood once and for all.
Suppose a model receives the instruction, “Send the updated version to the usual people once it is ready.” A fluent system may draft an email immediately, yet several facts remain unresolved: which version is authoritative, who counts as usual, whether a review is needed, and what “ready” means in this organization. A safer system can surface those gaps instead of treating them as invisible. This is why a language test should include the ordinary shorthand that people use with colleagues, not only tidy examples written for a benchmark. Evaluate whether the model distinguishes a request to act from a request to prepare, whether it keeps track of quoted material and speaker roles, and whether it changes course after a correction. These details are not merely linguistic niceties. They determine whether a useful assistant supports coordination or creates new work for the people who must repair a plausible but mistaken interpretation.