Conversion in community moderation declined after a pricing or policy change. Diagnose it

Problem Statement Description

You are the product manager for a community moderation product used by content moderators, community admins, and Trust & Safety operations teams to review reported content, act on policy violations, and keep user communities safe. Shortly after a pricing or policy change, the team sees a significant decline in conversion within the moderation workflow.

The change may have affected eligibility, feature access, moderator incentives, enforcement rules, queue prioritization, or the cost of using moderation capabilities. The decline is concerning because lower conversion could mean fewer communities adopting moderation tools, fewer flagged items receiving action, slower enforcement, or reduced moderator confidence in the system.

Your task is to diagnose the decline as an RCA problem. You should frame the anomaly clearly, define what “conversion” means in this moderation context, identify where the drop is happening, and determine whether the issue is caused by user behavior, product experience, policy interpretation, pricing impact, operational workflow changes, or measurement errors.

Your diagnosis should consider:

- The exact conversion metric, denominator, funnel steps, and time window before vs. after the pricing or policy change

- Segmentation by moderator type, community size, geography, content category, platform, enforcement policy, and paid vs. free eligibility

- Instrumentation checks, event tracking changes, data pipeline issues, and whether the metric definition changed during rollout

- Differences between adoption decline, workflow completion decline, action-rate decline, and appeal/reversal-rate changes

- Potential moderator pain points such as unclear policy guidance, reduced access to tools, higher cost, more friction, or lower trust in recommendations

- Evidence needed from logs, funnel analytics, moderator feedback, support tickets, QA audits, and safety outcome metrics

- Short-term mitigation options, longer-term prevention mechanisms, and how to monitor whether safety outcomes are recovering

The goal is to demonstrate a structured RCA approach that separates correlation from causation, protects community safety while the issue is investigated, and helps the team make a confident decision on whether to fix, roll back, iterate, or further monitor the pricing or policy change.