Limit tool candidates to 2-3 before evaluating — more…
Limit active tool candidates to two or three options maximum before evaluation—evaluating more options increases decision time logarithmically while decreasing satisfaction regardless of whether you choose objectively better tools.
When This Fires
- After defining the job (Define the specific job the tool must do in one sentence…) and requirements (Pick a tool with 5 minimum requirements, select the first…), when deciding which tools to evaluate
- When tool research has been ongoing for weeks with no convergence
- When a comparison spreadsheet has 10+ columns and still doesn't produce a clear winner
- Complements Pick a tool with 5 minimum requirements, select the first… (satisficing) and Define the specific job the tool must do in one sentence… (job definition) with the candidate-count constraint
Common Failure Mode
The comprehensive comparison: evaluating every tool in a category to ensure you've found "the best one." The comparison takes weeks, each new tool reveals features the others lack, and the decision feels harder with each addition rather than easier. By the time you choose, you've spent more time evaluating than you'll save in the first year of use.
The Protocol
(1) After defining your job and requirements, do a quick scan of available tools. Spend no more than 30 minutes identifying the landscape. (2) Filter to 2-3 candidates using hard requirements (Pick a tool with 5 minimum requirements, select the first…): which tools meet all 5 minimum requirements? If more than 3 pass, take the 3 most popular (larger community = better support). (3) Evaluate only these 2-3 candidates. Do not add more candidates during evaluation, even if someone recommends another tool. It goes on a list for the next evaluation cycle. (4) Choose among the 2-3 within your evaluation time budget (Scale tool evaluation effort to switching cost…). (5) Accept that you may have missed a slightly better tool by limiting to 3. The time saved by not evaluating it is worth more than the marginal improvement it might have offered.