Skip to main content

Preview — Pro guide

You are seeing a portion of this guide. Sign in and upgrade to unlock the full article, quizzes, and interview answers.

Engineering Craft·Intermediate

Product Metrics & North Star: How Engineers Define and Own Success

How to design a measurement system before you write code — selecting a north star metric, decomposing it into actionable driver trees, and choosing guardrail metrics that prevent gaming. Tested explicitly at senior and staff levels at Meta, Google, and Airbnb, and the skill that separates engineers who build impactful features from those who build busy ones.

35 min read 3 sections 1 interview questions
Product MetricsNorth Star MetricDriver TreeGuardrail MetricsProduct SenseCounter-MetricsFeature MeasurementEngineering LeadershipA/B Testing DesignBusiness ImpactKPI DesignGrowth Metrics

Why Most Engineers Measure the Wrong Thing

The most common failure mode in feature development isn't a bad implementation — it's measuring success by something that doesn't actually capture it. Teams optimize DAU when they should optimize retention. They ship a feature that increases clicks but decreases user trust. They hit their quarterly number and still destroy the product.

This is a discipline that interviewers explicitly test, especially at senior and staff levels. The question "How would you measure success for this feature?" is not a warm-up — it's a signal check for whether you think like a product engineer or a code-shipping machine.

The framework below is not abstract theory. It's the same structure that Meta uses for product goal-setting, that Google uses in PM and senior IC interviews, and that Airbnb has documented in their engineering blog for experiment design. The distinction you need to keep clear:

  • Production Engineering (the prod track on this platform) covers reactive measurement: what to do when a metric you're already tracking breaks, how to triage an anomaly in production, how to run an A/B test on a live system.
  • This guide covers proactive measurement design: how to choose what to measure in the first place, before you build, as part of designing the feature.
IMPORTANT

What the Interviewer Is Actually Testing

A 6/10 answer: "I'd track DAU, retention, and engagement." Generic, safe, tells the interviewer nothing.

A 9/10 answer: Explains the north star metric for this specific product, derives 2–3 driver tree components that are actionable for the team, names a guardrail metric and explains why it's needed, and surfaces the gaming risk. Takes 3–4 minutes. Shows you've actually shipped products.

IMPORTANT

Premium content locked

This guide is premium content. Upgrade to Pro to unlock the full guide, quizzes, and interview Q&A.