How do I know which business metrics actually matter?

Start with the decisions the business needs to make and work backward to the few measures that inform those decisions. Avoid tracking numbers that look interesting but do not change an action, priority, or forecast.