Questions › Root Cause Analysis › Top-AI-Interview
CSAT for an AI customer support chatbot dropped 20% after a model upgrade. Diagnose it.
- Root Cause Analysis
- Top-AI-Interview
- Easy
- 10 min
Focus on identifying potential causes for the drop in Customer Satisfaction (CSAT) following the model upgrade. Start by analyzing the changes made during the upgrade—consider aspects like response accuracy, tone, and the handling of complex queries. Evaluate user feedback and common complaints to pinpoint specific issues. Additionally, think about external factors that could have influenced CSAT, such as changes in user expectations or increased volume of inquiries. Conclude with recommendations for immediate actions to address the identified problems and improve CSAT.
What this question tests
- Root Cause Analysis
- Data Debugging
- Model Monitoring
- Incident Communication
Practise this question under interview conditions. Answer it out loud against a timer with an AI interviewer that asks follow-ups, then review the scored report.
Related Root Cause Analysis questions
- An enterprise AI agent is creating incorrect calendar changes. Diagnose it.Top-AI-Interview · Root Cause Analysis · Hard
- A RAG assistant started giving wrong citations even though answer quality looks stable. Diagnose it.Top-AI-Interview · Root Cause Analysis · Medium
- A music recommendation model shipped last month and repeat listening fell. Diagnose it.Top-AI-Interview · Root Cause Analysis · Medium
- An AI moderation system is missing more toxic comments after a policy update. Diagnose it.Top-AI-Interview · Root Cause Analysis · Medium
- Latency doubled for an AI writing assistant last week. Diagnose it.Top-AI-Interview · Root Cause Analysis · Easy
- Speech transcription accuracy dropped for Indian English users. Diagnose it.Top-AI-Interview · Root Cause Analysis · Easy
All Root Cause Analysis questions · Product manager interview questions by skill area