An internal assistant answers employee questions using the company's HR documents, including salary records. Testers find that carefully worded prompts make it reveal named colleagues' salaries, although the harmful-content filters flagged nothing. Which responsible AI principle is the assistant failing to meet?
Choose one.
Privacy and security includes making sure an AI system cannot be used to reveal private personal or organisational details.
Microsoft's guidance says developers must keep data secure and make sure the system itself cannot be used to reveal private personal or organisational information. Here prompts extract colleagues' salaries, so the assistant fails privacy and security. Reliability and safety is tempting because prompts are being used to misuse the system, but the content filters are built for harmful content categories; the harm here is the exposure of personal data.
- Identify what leaked: personal salary data.
- Recall that privacy and security covers what the system can be made to reveal, not just stored files.
- Explain why the content filters stayed silent: salary figures are not a harmful-content category.
- Choose privacy and security.
Exam tip: If an AI system can be coaxed into revealing personal data, privacy and security has failed.
Microsoft's Responsible AI Principles for Azure AI Fundamentals (AI-901) — the lesson that teaches this.