Skip to content
How to ThinkIn the Age of AI

Keep a two-week bias journal to build your personal error…

Conduct a two-week bias journal recording significant judgments with confidence levels, then categorize errors by direction and type to build your personal bias profile.

When This Fires

  • You want to improve your judgment but don't know where it's weakest
  • You suspect you're biased in certain domains but can't prove it
  • You're about to take on a role that requires calibrated judgment (leadership, estimation, risk assessment)
  • You've never systematically tracked your judgment accuracy

Common Failure Mode

Recording judgments but skipping the confidence calibration. Without confidence levels, you can't distinguish between being wrong about something you were uncertain about (normal) and being wrong about something you were certain about (a bias signal). The confidence level is what turns an error into information: being 90% confident and wrong is a much stronger signal than being 55% confident and wrong.

The Protocol

For two weeks: (1) At the end of each day, write down 2-3 significant judgments you made (estimates, predictions, assessments). (2) For each, record your confidence level (50-99%). (3) When outcomes become known, record the actual result. After two weeks: (4) Calculate your calibration — when you said 80% confident, were you right ~80% of the time? (5) Categorize errors: which domains, which direction, which judgment types. (6) The resulting profile tells you exactly where to apply correction factors and where to seek outside input.