Skip to content
How to ThinkIn the Age of AI

Question

What is experiment tracking?

beginner

Quick Answer

Record what you changed, why, and what happened — optimization without documentation is gambling.

Example: You spend a week tuning your morning routine: wake time, exercise order, caffeine timing, task sequencing. By Friday you feel better — but you changed four variables simultaneously and wrote nothing down. Which change helped? You don't know. Next month, when the routine decays, you can't reconstruct what worked. A colleague who logged each change with a one-line rationale and a one-line result can reconstruct, remix, and share their entire optimization history in minutes.

This concept is part of Agent Optimization in the How to Think curriculum, which builds the epistemic infrastructure for agent optimization.

Learn more in these lessons