Lessons tagged “calibration”
23 published lessons with this tag.
Calibration requires feedback
You cannot improve the alignment between your confidence and your accuracy without external data that reveals the gap between what you believed and what actually happened. Calibration without feedback is guesswork about guesswork.
Overconfidence is the default calibration error
Your brain does not fail randomly. It fails in a specific, measurable, predictable direction: too much confidence. Across decades of research, in every population tested, the dominant calibration error is overconfidence — believing you know more than you do, that your estimates are more precise than they are, and that your performance exceeds what it actually achieves.
Track your predictions
Recording what you expect to happen and comparing to what actually happens is the only reliable method for calibrating judgment. Without a written record, hindsight bias rewrites your memory of what you believed, making genuine learning from experience impossible.
The recency bias
Recent events disproportionately influence your perception of what is normal or likely.
Base rates matter more than narratives
Statistical base rates predict outcomes better than compelling individual stories. Your brain will fight this truth every time a vivid narrative competes with a dry statistic — and your brain will be wrong.
Calibration is domain-specific
Being well-calibrated in one area does not transfer automatically to others.
Pre-mortem as a calibration tool
Imagining failure in advance corrects for optimistic perception biases.
Seek disconfirming evidence
Actively looking for evidence against your current belief is the fastest path to calibration.
Other people are calibration instruments
Other perspectives correct for your systematic blind spots.
Record your calibration over time
A log of predictions and outcomes shows you exactly where your perception is off.
Bayesian updating in practice
Update the strength of your beliefs proportionally to the strength of new evidence.
Humility is accurate calibration
True humility is not thinking less of yourself but having an accurate model of your capabilities.
Well-calibrated perception is a competitive advantage
The ability to see clearly — not optimistically, not pessimistically, but accurately — is rarer and more valuable than most technical skills. Calibrated perception compounds into better decisions, and better decisions compound into better outcomes at every timescale.
Predictions test schemas
If your schema is correct it should make accurate predictions about what will happen next.
Validation builds warranted confidence
Confidence based on tested schemas is categorically different from confidence based on untested assumptions.
Trigger sensitivity calibration
Too sensitive and the agent fires too often — too insensitive and it never fires.
The trigger audit
Regularly review your triggers to ensure they are still relevant and well-calibrated.
Decision journals
Record decisions, their reasoning, and their outcomes to improve future decision-making.
Accuracy optimization
An agent that acts fast but wrong is worse than one that acts slowly but right.
Self-authority and humility coexist
Self-authority does not mean arrogance or certainty. The most powerful form of self-authority is the humble recognition that you are responsible for evaluating evidence and updating your beliefs — even when that means admitting you were wrong.
Building self-trust through track record
Self-trust is not built through affirmation — it is built through keeping promises to yourself and accumulating evidence that your judgment is reliable.
Time estimation skills
Most people underestimate how long tasks take — not because they are careless, but because human cognition is systematically biased toward optimism when imagining future work. Estimation is a skill that improves only through deliberate practice: estimate, track actual time, compare, recalibrate, repeat.
Building team epistemic practices
Teaching your team the individual epistemic practices from this curriculum — calibrated confidence, assumption surfacing, perspective taking, evidence evaluation — creates collective capability that exceeds the sum of individual skills.