Prompt injection risk in AI features that read user content
A support assistant is asked to summarize a customer’s email. The email contains a sentence that looks like part of the mess…
A support assistant is asked to summarize a customer’s email. The email contains a sentence that looks like part of the mess…
An agent can spend six minutes calling the same search tool with slightly different queries and still finish with, “I couldn…
The review had four action items. Two of them said "update the system prompt to clarify that the assistant must not can…
Picture a support ticket with two agents working it. One is a triage agent that classifies incoming messages and updates pri…