Design an experimentation dashboard for Kids Profiles

Problem Statement Description

Product context: Netflix is a streaming entertainment company; its products include subscription video, original films and series, recommendations, profiles, games, and ad-supported plans.

Netflix wants to improve how teams evaluate product experiments that affect Kids Profiles, especially for families who may be at risk of disengaging or who have previously lapsed and returned. These experiments may involve content discovery, personalization, parental controls, profile setup, streaming experience, or age-appropriate engagement surfaces across global markets.

Your task is to define what an experimentation dashboard should help internal teams understand when a Kids Profiles experiment is running or has completed. The primary users are likely product managers, data scientists, engineers, designers, and content or personalization teams who need to make confident launch, iterate, or stop decisions without compromising child safety, parental trust, or the broader household experience.

This is a metrics-focused question. The emphasis is not on visual UI polish, but on what the dashboard should measure, how metrics should be defined, how experiment results should be segmented and interpreted, and what guardrails are necessary for a children’s entertainment experience inside a subscription product.

The experience should consider:

- Clear definitions for success metrics, including the numerator, denominator, time window, and eligible population for each metric

- How to distinguish Kids Profile behavior from overall household behavior, parent-controlled actions, and shared-device usage

- Experiment cohorts such as new Kids Profiles, active families, lapsed or reactivated subscribers, age bands, regions, languages, devices, and content maturity settings

- Instrumentation requirements for exposure, assignment, playback, browsing, search, profile switching, parental controls, and completion events

- Guardrail metrics related to child safety, parental trust, streaming quality, excessive usage, content appropriateness, cancellations, and support contacts

- Statistical readout needs, including confidence, sample size, duration, novelty effects, seasonality, and heterogeneous treatment effects

- Decision usefulness for launch reviews, including whether the dashboard helps teams compare trade-offs between engagement, retention, discovery quality, and risk

- Privacy, compliance, and data minimization expectations when measuring behavior associated with children’s profiles

The goal is to describe a dashboard framework that would allow Netflix teams to evaluate Kids Profiles experiments responsibly and consistently, with enough metric rigor and segmentation to support product decisions across a global family entertainment context.