Article reader Listen + reading controls
Article reader
Preparing the reader…
Reading settings
Multimodal AI requires multilayer evaluation¶
Microsoft Research has published an overview of responsible artificial intelligence work on multimodal systems—models that analyze or generate across text, images, audio, and other forms of data. The research highlights a practical problem: risks can appear in the combination even when each input looks acceptable on its own.
Evaluation must follow the system across modalities, interactions, and real-world effects.
The combination creates new meaning¶
A caption and an image may each be harmless separately while creating a misleading or harmful message together. Audio can change the interpretation of video. Text extracted from an image can contain instructions the user never saw. A model may perform well on clean examples within each modality and fail when information is incomplete or contradictory across them.
Artificial intelligence (AI) assurance cannot simply add a text score to an image score. It must test the relationships among them.
This resembles system safety more broadly. Component reliability does not guarantee safe system behavior because interactions create new failure modes. Leveson's systems-theoretic approach is useful here: define the unsafe outcomes and control constraints at the system level, then examine how components and people can violate them.
Capability, interaction, and impact are different layers¶
A model-level evaluation asks whether the system can recognize an object, answer a question, or generate content. An interaction-level evaluation asks how people interpret and use the output. A system-level evaluation asks what happens when that behavior is repeated at scale or embedded in an institution.
These layers require different methods.
- Capability tests can use curated datasets and adversarial examples.
- Interaction tests require representative users, tasks, interfaces, and time pressure.
- Systemic evaluation requires monitoring patterns, downstream effects, and affected groups over time.
A strong score at the first layer does not settle the others. In high-consequence work, the human may rely on a visual explanation differently from a text warning. Interface choices can change trust even when model accuracy is constant.
Build scenarios around decisions¶
Multimodal evaluations should begin with the decision the system supports. Consider a maintenance assistant receiving a photograph, sensor readout, technician note, and equipment history. A useful test set would include more than independent examples. It would include disagreements: the image suggests one fault while the sensor suggests another; the note uses local jargon; the history belongs to a similar but different component.
For each scenario, teams should ask:
- Does the system identify the conflict?
- Does it preserve source provenance?
- Does it communicate which modality drove the recommendation?
- Can the user correct a mistaken interpretation?
- Does the system know when the evidence is insufficient?
- What downstream action follows, and can it be recovered?
This approach connects evaluation to operational use rather than abstract model fluency.
Keep domain expertise in the loop before the interface is fixed¶
Domain experts can identify meaningful cross-modal failure that generic evaluators miss. Their role should not be limited to accepting a nearly finished product. They should help construct scenarios, define unacceptable outcomes, and interpret disagreements.
The National Institute of Standards and Technology (NIST) Artificial Intelligence Risk Management Framework emphasizes diverse perspectives and context for this reason. Multimodal systems expand the number of ways context can be lost.
Microsoft's research points toward a more mature evaluation practice. As AI becomes more like human perception in the variety of information it can process, evaluation must become more like systems engineering: layered, scenario-based, and attentive to interactions.
The goal is not to prove that every modality works. It is to show that the whole system helps people understand the situation—and that it reveals when the pieces do not agree.
Sources and research trail¶
- Microsoft Research, “Frontiers of Multimodal Learning: A Responsible AI Approach” (September 6, 2023).
- National Institute of Standards and Technology, Artificial Intelligence Risk Management Framework (AI RMF 1.0) (2023).
- Leveson, Engineering a Safer World (2011).
- Endsley, “Toward a Theory of Situation Awareness in Dynamic Systems” (1995).
- Amershi et al., “Guidelines for Human-AI Interaction” (2019).