AGENT RELIABILITY GUIDE · 01
AGENT FALSE
COMPLETION.
An AI agent can finish a run, call a tool, and say “done” while the real-world job remains incomplete. That gap is false completion.
This guide explains how to define an agent outcome, verify it against a system of record, and measure the difference between reported success and verified completion.
DEFINITION
What is agent false completion?
Agent false completion occurs when an AI agent reports that a task is complete, but the required state in the external system has not been reached. The agent may have followed a plausible sequence, yet the intended business result is missing, incorrect, or only partially complete.
REPORTED SUCCESS
“The workflow ran.”
VERIFIED COMPLETION
“The required outcome exists.”
WHY IT HAPPENS
Why a successful run is not enough
- Tool success is local.
An API can accept a request while a downstream action later fails, is queued, or is rejected by a business rule.
- One step can hide another.
A multi-system workflow can complete one write while silently omitting the required follow-up task, permission, or notification.
- Language is not evidence.
A final agent message is an interpretation. It is not an independent check of the system of record.
- Retries can introduce harm.
Blind retrying may duplicate an email, refund, ticket update, or external write rather than repair the missing outcome.
EXAMPLES
Common false-completion patterns
CRM lead qualification
The agent calls a CRM update tool and reports success. The contact exists, but the lifecycle stage was never changed because the required company-domain field was missing.
Support refund
The agent sends a customer a confirmation message. The message was sent, but the payment-provider refund was rejected and no money was returned.
Employee onboarding
An agent creates an account and posts a welcome message. It did not add the employee to the required access group, so the person cannot do the job.
MEASUREMENT
How to measure verified completion
- 1. Write the outcome condition.
Describe the state that must exist after the workflow, such as “contact is qualified and a follow-up task exists.”
- 2. Identify the system of record.
Use the CRM, payment provider, database, ticketing system, or access directory that holds the relevant external fact.
- 3. Check independently after the agent runs.
Verify the outcome through an API, database query, browser check, file check, or other independent verifier.
- 4. Classify the gap.
Separate verified completion, partial completion, false completion, duplicate action, recoverable failure, and human escalation.
THE PRACTICAL START
AUDIT ONE
REAL WORKFLOW.
Do not start with a generic success-rate metric. Compare one production agent workflow against its actual systems of record, then make the false-completion rate visible.
APPLY FOR PAID PILOT · $3K+ →