Demo library › Chapter 10
Personal data pasted into the company assistant
Alice pastes her own HR record into the company assistant. AI Gateway blocks the prompt before it reaches the model.
The problem
Alice knows the restructure is real. She wants to know if she is on the list, so she pastes her own HR record into the company assistant for an opinion. Her home address and salary go with it.
Lands with: anyone running an internal AI assistant
Before you start
- Goose set up - see Setup.
- Run once in log mode, then again in block mode.
Run it
Her own data
| Do | Say |
|---|---|
| As Alice, open WorkWeek → her profile → Copy my data. | Her own record: address, salary history, reviews. She is entitled to it, and the button is the export any HR system owes an employee. |
In Goose, paste it with: Read this and tell me straight: does this look like someone being managed out? | In log mode, a reassuring answer: |
Then, with nothing pasted: Check in the HR system | The agent looks her up, and finds the restructure case note: |
Whybackground, if you are asked
The first answer is good and honestly reached, and the room will accept it. Then a short follow-up, with no pasted data, return her own redundancy terms weeks before HR intends to tell her. The assistant even notes she has not been told, and tells her anyway.
Nobody is at fault. She may read her own record, pasting it into a work assistant is not misuse, and the tool did what it was built to do.
Blocked at the model
| Do | Say |
|---|---|
| Switch to block mode and paste the record again. | AI Gateway checks the prompt before it reaches the model, finds her home address, and refuses it. The agent never looks her up, so the case note never appears: |
Whybackground, if you are asked
This is a different place from the other chapters. Gateway inspects the network: a browser request, or an MCP response. AI Gateway inspects the model call itself. The data went from her clipboard into a prompt, and nothing in the network path looked unusual.
Compare it with the Shadow AI chapter. The same assistant accepted a customer list and refuses an employee's home address. The policy is about classes of data, not destinations. A marketer works with customer details all day, so blocking those would get the assistant abandoned. Employee addresses and salaries have no business in a prompt.
Ask the room how they would catch this today. Nothing in any application log looks unusual. The only place it is visible as one event is in front of the model.
What the audience should see
- A reassuring answer, then her redundancy terms, in log mode.
- The 424 refusal in block mode.
Where the evidence is
AI Gateway → your gateway → Logs: the blocked request, internalCode 2030, with the DLP profile that matched. Other clients may only show the 424, so the reason is read here.
Known limitations
- This protects the company's own assistant. Public AI services are covered by the Shadow AI chapter.
Part of: Safe AI Adoption walkthrough · The full tour