A Short Guide to Metrics

Simple rules to follow when creating metrics

  1. Over time: You must see how metrics change over time. Ideally you can view them by day, week, and month. No pie charts!
  2. In groups: Metrics require balance. Think of the extremes. If you over-optimize for one metric, what problem will it create?
  3. Weighted appropriately: If different times of the week or geographic areas are more important, your metrics should reflect this.
  4. Robust: Chances are your data is not pristine. Be careful of outliers. Median or percentile can be better than the mean.
  5. Keep it simple: People should be able to understand the metric.

Nice to have

  1. Responsive: Prefer metrics that change quickly as a result of your actions.

Published November 5, 2017 · Tweet


You might also enjoy

The Two Metrics You Need

Why and How to Keep Your Decryption Keys Off Web Servers

Argon2 with Devise


All code examples are public domain.
Use them however you’d like (licensed under CC0).