Accountability for AI Agent Mistakes: Who Answers
Accountability for AI agent mistakes lands on whoever assigned the work and set its permissions, not the model vendor. Here's why, and what to write down first.
Every AI governance conversation reaches the same question eventually: when the agent gets it wrong, who actually answers for it? Four candidates get proposed in almost every version of this conversation, the operator who ran the task, the approver who assigned it, the vendor who built the tool, and the provider that trained the model underneath it. Only one of those four survives contact with an actual audit, and most PMOs have not decided which one before they need the answer.
The direct answer: accountability for AI agent mistakes lands on whoever assigned the work and set the permission scope it acted inside, the same person who would answer for a human report's mistake made under their direction. The tool vendor and the model provider are contractual parties, not accountable parties inside your own audit, and naming either of them "responsible" just delays writing the policy that actually holds up.
Four candidates get named when an AI agent's mistake needs an owner: the operator, the approver, the tool vendor, and the model provider. The vendor and the provider are outside your audit boundary and can carry contractual liability at most. Between the operator and the approver, accountability lands on whoever assigned the task and set its permission scope, because that decision is what determined what the agent was allowed to touch. A PMO that writes this down before an incident gets a consistent answer; one that waits gets a political fight the day it matters most.
Accountability for AI Agent Mistakes: The Four Candidates
Here is how each one holds up once an auditor actually asks the question.
| Candidate | The case for them | Why it does or doesn't hold |
|---|---|---|
| The operator who ran the task | They triggered the specific run | Rarely accountable alone: they usually acted inside a scope someone else defined |
| The approver who assigned the work | They set the permission scope and accepted the risk | Holds. This is the accountable party in almost every case |
| The tool vendor | They built the feature that misfired | Contractually liable under an SLA, not organizationally accountable inside your audit |
| The model provider | They trained the model that produced the output | Never saw your data, scope, or policy; naming them is a category error |
Why Three of the Four Don't Survive an Audit
The operator alone rarely holds up because they were usually following an authorized scope, not exercising independent judgment about what the agent should be allowed to touch. Punishing the operator personally teaches people to stop using the tool, or worse, to stop reporting when something goes wrong, neither of which is the outcome a policy should produce.
The tool vendor holds contractual accountability: a support agreement, an uptime SLA, a liability clause in the terms of service. That is real, but it is a different question from who inside your organization answers for this specific decision. A PMO cannot point to a vendor's contract as its own internal audit trail.
The model provider is the easiest to eliminate and the most commonly proposed, usually right after an incident when the instinct is to find the biggest name in the chain. But the provider trained a general-purpose model with no visibility into your permission scope, your data, or your policy. It cannot be accountable for a decision it never had the context to make.
Who Is Actually Accountable
The approver, the person who assigned the agent its task and set the permission scope it operated inside, is the one who survives. This is the same standard already applied to human delegation: a manager who assigns work to a report and defines what that report can approve is accountable for the outcome, even though the report did the actual work. An AI agent does not change that chain; it changes how fast decisions happen and how many of them get made, which is exactly why the scope has to be set deliberately instead of defaulting to whatever access was easiest to grant.
Who is accountable when an agent treated as a team member makes a mistake covers the same conclusion from the identity side: a named persona with a defined scope is what makes this chain traceable at all. Without a persona and a scope, "the AI did it" is the only answer left, and that answer satisfies nobody in an audit.
The diagram below shows the four candidates and where the accountability chain actually terminates.
What to Write Into the Policy Before You Need It
A PMO that decides this in advance gets a consistent answer under pressure. One that waits gets a political fight on the worst possible day.
- Name the accountable role explicitly, by seat, not by team. "The PMO" is not accountable; the PMO director who approved the agent's scope for that task class is.
- Log the permission scope at the moment of assignment, not reconstructed afterward from memory or a support ticket.
- Define what counts as expensive to undo for your own work, so the accountable person knows in advance which task classes need approval before they run and which can be reviewed after the fact.
- Set a review cadence for every task class currently running on-the-loop, so a widening scope gets re-evaluated on a schedule instead of by accident.
- Decide the answer to "who's accountable" while nothing has gone wrong yet. Naming the accountable seat is the clause every other clause in a governance policy depends on; write it first.
The five levels of AI agent autonomy maps how this accountability question changes as an agent's scope widens: the higher the level, the more the permission-scope decision is doing the actual work of protecting the organization. AI governance for PMOs covers the broader policy structure this accountability clause sits inside. The NIST AI Risk Management Framework makes the general case for the same practice: oversight has to be built into the system's design, not bolted on after an incident forces the question.
None of this is unique to any one vendor's agent. The chain, operator, approver, vendor, provider, is the same regardless of which tool ran the task, and the answer is the same too: it lands on the person who decided what the agent was allowed to do. The rest of the Onplana blog covers the adjacent governance decisions, autonomy levels, audit trail requirements, and what a policy needs to say before the first incident makes the question urgent.
Frequently asked questions
Who is accountable when an AI agent makes a mistake?
The person who assigned the work and set the agent's permission scope, the same person who would answer for a human report's mistake made under their direction. The agent changes the speed and volume of decisions, not who answers for them.
Can the model provider be held accountable for an agent's error?
No. The model provider never saw your permission scope, your data, or your policy, so naming it accountable is a category error, not an answer. It may carry contractual liability under its terms of service, but that is separate from internal accountability inside your own audit.
Is the tool vendor accountable when its agent feature causes a problem?
The vendor is contractually accountable for the tool doing what it was sold to do, covered by an SLA or a support agreement, but that is not the same as organizational accountability for the specific decision. A PMO cannot outsource its own audit trail to a vendor's terms of service.
Can an agent do something irreversible before anyone catches it?
Yes, if its permission scope allows it, which is exactly why the scope, not the agent's judgment, is the control that matters. Irreversible actions belong behind an approval gate regardless of how reliable the agent has been on everything else.
What if the person who assigned the work didn't know the agent could do that?
Then the permission scope was set wrong, and that is still the assigning person's accountability, not an excuse that shifts it elsewhere. Part of assigning work to an agent is knowing what its access actually allows, the same diligence expected before handing a new hire a login.
Can someone steer an agent around the accountable person's oversight through a comment?
Only if the agent's authority is a convention instead of a permission system. A comment should be able to request work, not grant access; if a comment alone can widen scope, the accountable person has already lost the control the policy assumes they have.
Does the accountable person have to review every action personally?
No. They can delegate review, in the loop for expensive-to-undo work and on the loop for high-volume, cheap-to-reverse work, but they cannot delegate the accountability itself. Choosing a review posture is their decision to make and their decision to answer for.
Is a written AI agent accountability policy actually necessary, or is this obvious in practice?
It is necessary because the question always surfaces after an incident, when the pressure to find someone to blame is highest and the least reliable time to design a fair answer. Writing the policy before the first real incident is what keeps the answer consistent instead of political.
Ready to make the switch?
Start your free Onplana account and import your existing projects in minutes.