What are vanity metrics, and how do I avoid them?

Question

Accepted Answer

Vanity metrics are numbers that flatter the team without reflecting the customer's outcome: clicks instead of completed tasks, activity instead of results. Chapter 5 of the book tells of a team that celebrated soaring feature clicks while confused customers flooded the phones, and had to rebuild its measures around task completion and satisfaction.

A vanity metric is a number that makes the team look good while telling it nothing about the customer. Chapter 5 of the book teaches the trap through a case study: a team launched a new website feature and measured clicks. Week-one clicks were through the roof. The team sent a celebratory email to the whole department and held a team lunch.

Meanwhile customer service was fielding a rise in calls. Customers were clicking the feature and then failing to complete the task they came for. The measure rewarded the click; the customer's job went undone. The team had to go back and choose measures that reflected the real outcome: task completion rate and customer satisfaction.

The book's defence is to run every candidate metric through its four tests: is it relevant to a goal that matters, measurable reliably, actionable when it moves, and trackable over time? Clicks passed measurability and failed relevance, which is the vanity pattern exactly: the number is easy to count and flattering to report.

A practical check before adopting any metric: if this number doubled next month and nothing else changed, would a customer notice? If not, it is measuring your activity, not your value, and it will quietly steer the team toward theatre. Measure the outcome the customer feels, and let activity metrics stay where they belong, as diagnostics rather than headlines.

What are vanity metrics, and how do I avoid them?

Related questions