When a pattern reverses across subgroups, disaggregate…
When a pattern appears to reverse across subgroups in your data, disaggregate by relevant context variables (sleep, stress, social setting) before drawing conclusions from the aggregate pattern.
When This Fires
- When personal data analysis shows a clear correlation and you're about to act on it
- When a productivity or health pattern seems inconsistent — sometimes it holds, sometimes it doesn't
- When aggregate data contradicts your lived experience in specific situations
- Any personal analytics context where subgroup effects could reverse the aggregate trend
Common Failure Mode
Acting on aggregate patterns without checking subgroups. "Coffee helps my productivity" becomes a blanket rule, but on sleep-deprived days, coffee increases jitters and reduces focus. The aggregate truth hides the contextual lie. You're optimizing for the average case while your actual days are never average.
The Protocol
When you identify an aggregate pattern: (1) List 3-4 context variables that could moderate the pattern (sleep, stress, time of day, energy level). (2) Disaggregate: split your data by each variable. Does the pattern hold in both subgroups? (3) If it reverses in a subgroup → the pattern is context-dependent, not universal. Apply it only in the contexts where it holds. (4) If it holds across all subgroups → the pattern is robust. Act on it with higher confidence.