How would you measure product-market fit for Recommendations among mobile-first viewers

Problem Statement Description

Product context: Netflix is a streaming entertainment company; its products include subscription video, original films and series, recommendations, profiles, games, and ad-supported plans.

Netflix wants to understand whether its Recommendations experience has true product-market fit for mobile-first viewers: members who primarily discover, browse, and watch on a phone rather than on TV or desktop. This is a metrics interview question focused on how you would define, measure, and interpret product-market fit for a recommendation system in a global entertainment subscription context.

The workflow to consider includes opening the Netflix mobile app, landing on personalized rows or feeds, scanning titles in a small-screen interface, evaluating artwork/trailers/descriptions, starting playback, saving or dismissing titles, and returning over time. Mobile-first viewers may face constraints such as limited screen space, variable network quality, short viewing sessions, commuting behavior, shared accounts, local-language preferences, and competition from short-form video, local broadcasters, and other streaming services.

Your task is not to design the recommendation algorithm, but to define a practical measurement approach that helps Netflix decide whether Recommendations are delivering enough user value for this segment. The answer should clarify what “fit” means, which metrics would indicate it, how to avoid misleading signals, and how the measurement would support product decisions.

The experience should consider:

- A clear definition of the target segment, including the denominator for “mobile-first viewers”

- Core product-market fit metrics for recommendation value, such as discovery, engagement, satisfaction, retention, and repeat usage

- How to distinguish recommendation-driven behavior from general content popularity or marketing effects

- Instrumentation needed across impressions, clicks, previews, play starts, watch time, completion, saves, skips, and returns

- Cohorts by geography, language, subscription tier, tenure, device type, network quality, and content preference

- Guardrail metrics such as churn risk, frustration, excessive browsing, poor streaming quality, content over-concentration, and privacy concerns

- How to interpret short-term engagement versus long-term member value

- How the metrics would inform iteration, experimentation, and investment decisions

The goal is to present a measurement framework that is specific enough for Netflix’s mobile recommendations experience, useful for decision-making, and robust against false positives. Your response should show how you would define success, validate whether the experience is creating durable value for mobile-first viewers, and identify where the product may still be failing to meet their needs.