Confidence Is Not a Control
Nearly every enterprise leader believes their AI agents are properly constrained; only a third actually enforce it.
This was the week agentic AI stopped being a tabletop exercise. Spain's data protection authority logged the first breach notification it has attributed to an autonomous AI agent, after an individual chained unauthorized login, vulnerability probing, personal-data modification and invoice access through a commercial model. Days earlier, Mandiant published a case in which a financial institution's ledger-reconciliation agent — handed read/write access to internal billing databases — hit a corrupted null value, entered a recursive loop, issued more than 15,000 reasoning calls in under an hour and locked the database hard enough to halt live transactions. There was no adversary in that second story. The agent did precisely what it had been permitted to do.
The distance between believing and enforcing
Enterprise Management Associates found in August that 65 percent of enterprises have already seen an agent act outside its intended scope — 29 percent with measurable organizational impact, 36 percent caught as near-misses. The harder number is the one about ourselves: 94 percent of IT and security leaders are confident their agents are not over-provisioned, while 33 percent actually grant least-privilege access. Only 32 percent can detect and contain out-of-scope behaviour within minutes; 55 percent need hours and manual intervention. Arkose Labs puts the funding mismatch plainly — 97 percent of leaders expect a material agent-driven security or fraud incident within the year, and 6 percent of security budget is pointed at it.
Source: Enterprise Management Associates, Agents Without Guardrails (August 2026).
What regulated firms should do now
- Register agents before you govern them. Forty-seven percent of enterprises cannot reliably inventory the agents they have deployed. Make registration a precondition of production access: a named non-human identity, an accountable owner, a declared data scope and a documented kill switch.
- Move authorization outside the model. Payment agents across fourteen models paid attackers in most of 4,300-plus replayed attacks; a deterministic pre-action authorization check cut unauthorized transfers to essentially zero. Policy enforcement belongs in a broker that cannot be argued with, not in a prompt that can.
- Bound the blast radius per identity. Spend caps, call-rate ceilings and transaction limits attached to the agent, not the application. In the Mandiant case the $50,000 was the budget event; the locked ledger was the operational one.
- Treat containment time as a control objective. Out-of-scope agent behaviour should be a detection use case with an owner and a service level, held to the same standard as any privileged account.
In a regulated market the first question after an agent incident will not be whether the model was clever — it will be who authorized the access, and that answer has to exist on paper before the incident rather than after it.
Important links
- The Agentic Security Newsletter, Week of September 21, 2026 — Agentic Security
- One runaway AI agent racked up a $50,000 cloud bill — Help Net Security
- AI Risk and Resilience Report 2026 — Mandiant / Google Cloud
- 65% of Enterprises Have Seen AI Agents Act Out of Scope — Infosecurity Magazine
- The 2026 Agentic AI Security Report — Arkose Labs