Choose north star and guardrail metrics for a new video meeting experience

Problem Statement Description

You are evaluating a new video meeting experience designed for operations managers who run recurring cross-functional meetings such as daily standups, incident reviews, staffing syncs, vendor check-ins, and performance reviews. These users care less about novelty and more about whether meetings help teams make decisions, unblock work, document outcomes, and reduce follow-up churn.

The product may include improvements such as better agenda handling, participant engagement signals, in-meeting collaboration, summaries, action items, reliability upgrades, or workflow integrations. Your task is not to design the features, but to define how the team should measure whether this new experience is actually improving meeting effectiveness at scale.

In this metrics interview, choose a north star metric and a set of guardrail metrics. Be clear about what each metric means, who or what is counted, the time window, the denominator, and how the metric would be instrumented. The metrics should help product, engineering, design, and business stakeholders decide whether to launch, iterate, or roll back changes.

The experience should consider:

- The primary user cohort: operations managers, their teams, and recurring business meetings.

- What “meeting effectiveness” means in measurable product behavior, not just satisfaction.

- The correct unit of analysis, such as meeting, participant, organizer, team, or account.

- Denominators and eligibility rules, including scheduled meetings, attended meetings, recurring meetings, or meetings using the new experience.

- Instrumentation across pre-meeting, in-meeting, and post-meeting workflows.

- Cohort cuts such as meeting size, meeting type, role, organization size, geography, device, and tenure.

- Guardrails for reliability, latency, audio/video quality, accessibility, privacy, user trust, and unintended meeting overload.

- How the metrics would support decisions across experimentation, launch readiness, and long-term product health.

Your goal is to propose a measurement framework that captures meaningful improvement in meeting outcomes while protecting the core expectations of a video meeting product: dependable communication, inclusive participation, and user trust.