Questions › Metrics › Top-Interview
You're designing an A/B test to evaluate the impact of showing content from non-friends in users' feeds. How would you test this with proper randomization?
- Metrics
- Top-Interview
- Medium
- 10 min
Focus on outlining a clear A/B testing framework that includes defining your control and experimental groups. Specify how you would randomly assign users to each group to ensure unbiased results, considering factors like user demographics and behavior patterns. Discuss the metrics you would track to measure the impact of non-friend content, such as engagement rates, time spent on the platform, and user satisfaction. Finally, address how you would ensure the test runs for an appropriate duration to gather statistically significant data, and how you would analyze the results to draw actionable insights.
What this question tests
- Metrics
- Structured problem solving
- Communication
- Trade-off reasoning
Practise this question under interview conditions. Answer it out loud against a timer with an AI interviewer that asks follow-ups, then review the scored report.
Related Metrics questions
- You're a PM for Meta's Verified Badge. Why would Meta build this product and how would you set goals and success metrics for it?Top-Interview · Metrics · Hard
- What are the most important metrics for DoorDash?Top-Interview · Metrics · Hard
- How would you improve the quality of Airbnb over the next six months?Top-Interview · Metrics · Hard
- Define success metrics for Zoom for Business.Top-Interview · Metrics · Hard
- As a PM for Meta, how would you measure the success of launching a job marketplace?Top-Interview · Metrics · Hard
- You're a PM at a top-up team. How would you launch cash deposits? If one of the main KPIs is down, how would you go about addressing it?Top-Interview · Metrics · Hard
All Metrics questions · Product manager interview questions by skill area