Question
What does it mean that agents must be specific and testable?
Quick Answer
Vague agents do not fire reliably — specificity is required.
Vague agents do not fire reliably — specificity is required.
Example: Compare two agents designed to improve post-meeting follow-through. Agent A: 'I will be better about following up after meetings.' Agent B: 'When a meeting ends and I was a participant, I will open my notes app within 2 minutes and write exactly three bullet points: one decision made, one action assigned to me, and one open question.' Agent A has no trigger specificity (which meetings?), no condition (what counts as a meeting worth following up on?), no measurable action (what does 'better' look like?), and no testability (how would you know if it fired?). Agent B specifies the trigger (meeting ends), the condition (I was a participant), the action (three categorized bullet points in a specific app), and the time constraint (within 2 minutes). After one week, you can count: how many meetings did I attend, and how many times did the three-bullet-point protocol execute? If the ratio is below 80%, the agent is failing and you can diagnose why. Agent A cannot be diagnosed because it cannot be measured.
Try this: Select one agent you currently run — a rule, habit, or protocol you follow in recurring situations. Write it down exactly as it exists in your mind right now. Then apply the specificity test: (1) Can you identify the exact trigger — the observable event that should activate this agent? (2) Can you state the condition — the criteria that must be true for the agent to fire? (3) Can you describe the action in enough detail that someone else could execute it identically? (4) Can you define what success looks like in measurable terms? For each dimension that fails the test, rewrite it with concrete specificity. Then define your falsification criterion: what observable outcome over the next seven days would prove this agent is not working? Run the agent for one week and check the data.
Learn more in these lessons
- Agents must be specific and testable
Vague agents do not fire reliably — specificity is required.
Go beyond the answer
This topic is part of Your Personal AI Operating System — a guided sequence of 16 lessons.
After completing this path you will run a four-layer personal AI operating system: a persistent context layer (the AI knows your role, standards, and current work), a skill library (your repeated tasks specified once, invoked by name), scheduled routines (recurring work that runs without prompting), and a verification layer (specific, testable, documented agents you actually trust). You own the architecture; the tools become interchangeable.
Start the path →