Investigate why conversion fell after a Games launch

Problem Statement Description

Product context: Netflix is a streaming entertainment company; its products include subscription video, original films and series, recommendations, profiles, games, and ad-supported plans.

Netflix has recently launched or expanded Games experiences for ad-supported members, such as game discovery surfaces, promotional modules, onboarding questions, or cross-product entry points within the Netflix app. Soon after the launch, the team observes a decline in conversion among ad-supported users. The concern is whether the Games launch introduced friction, changed user intent, affected content discovery, or coincided with an unrelated market or measurement issue.

Assume the impacted users are on or considering the ad-supported Netflix experience, and conversion may refer to a clearly defined business action such as moving from exposure or signup intent to subscription completion, upgrading from ad-supported to a higher-value plan, or completing another agreed conversion step. Your task is to frame the RCA, validate the anomaly, and identify the most likely drivers without jumping directly to a product fix.

The investigation should account for Netflix’s global entertainment context, multiple device types, localized experiences, personalized recommendations, ad-supported plan dynamics, and possible competition for user attention from short-form video, streaming, live content, and gaming alternatives.

The experience should consider:

- The exact conversion metric definition, numerator, denominator, time window, and whether the drop is absolute or relative.

- Whether the decline is isolated to users exposed to Games surfaces versus broader ad-supported cohorts.

- Segmentation by geography, device, app version, acquisition channel, tenure, language, age-appropriate profiles, and engagement level.

- Funnel steps before and after the Games launch, including impression, click, onboarding, gameplay start, content discovery, plan selection, payment, and completion.

- Instrumentation checks for event logging, attribution changes, experiment assignment, tracking gaps, and delayed data pipelines.

- Product hypotheses such as Games creating distraction, confusing value proposition, increasing app latency, crowding out TV/movie discovery, or affecting ad-load perception.

- External and timing factors such as pricing changes, content slate, seasonality, competitor launches, marketing campaigns, or payment issues.

- Evidence needed to distinguish correlation from causation, including A/B exposure, holdouts, pre/post trends, and comparable unaffected segments.

The goal is to walk through a structured root-cause analysis that helps Netflix determine whether the Games launch contributed to the conversion decline, which users or funnel stages are affected, how severe and persistent the issue is, and what decision-ready evidence the team should gather before taking action.