Product Strategy Case Study
Interactive Presentation
Live PreviewNavigate through the presentation below. Use arrow keys or click through slides. Initial loading may take a few seconds.
Loading presentation...
Organizations process 211,000+ HR tickets annually, with 70% being routine questions.
Employees frequently need answers to:
This creates:
Designed an AI agent with intelligent scope definition, guardrails, and escalation workflows:
Technical Architecture:
Phased Rollout Strategy:
Focus on augmentation, not replacement - complex cases still route to human experts.
Transformed employee support experience:
Efficiency Gains:
Quality Improvements:
Baseline: 211,000 annual HR/IT/Legal/Compliance tickets, $75 average cost per ticket (ServiceNow data), 3-5 day average resolution time. Analyzed 12 months of historical ticket data across 10,000-employee organization.
Chose RAG architecture over fine-tuning for better explainability and easier knowledge base updates. Started with low-risk HR queries (benefits, PTO) before expanding to sensitive legal/compliance topics. Prioritized accuracy (95%+ threshold) over instant response speed (2-3 seconds acceptable).
Ticket deflection measured via ServiceNow analytics (70% reduction = 148K tickets). Response time tracked through system logs. Cost per query calculated from infrastructure + API costs divided by query volume. CSAT measured via post-interaction surveys (n=5,000+ responses over 6 months).
2-3 second latency acceptable (vs instant responses). Text-only initially (document retrieval deferred to Phase 2). Required role-based access controls (added complexity). Human escalation required for edge cases (not 100% automated). Limited to English initially (multilingual Phase 3).
Cross-Functional Team Leadership:
Key Technical Decisions:
RAG vs. Fine-Tuning:
Accuracy vs. Speed:
Phased Feature Rollout:
Challenges Navigated:
Market Differentiation:
vs. Generic Chatbots:
vs. Microsoft Viva & Workday Assistant:
Key Advantage: Purpose-built for enterprise support workflows, not adapted from consumer chatbots.
Key Learnings:
The phased rollout was crucial for building trust. Starting with low-risk HR queries (benefits, PTO) allowed us to refine the system before handling sensitive legal/compliance topics.
Most Important Lesson: "Garbage in, garbage out" applies strongly to RAG systems. Would invest more in knowledge base cleanup upfront - quality documentation directly determines AI answer quality.
What Worked Well:
What I'd Do Differently:
Product Manager & AI Implementation Lead
Domain: Enterprise SaaS / Employee Experience