LangChainBased on real interviews
Triage a production support-agent incident
Identify the failing layer before rolling back a model that may not be the cause.
Unlock with Full AccessThe challenge
A billing and account-support agent starts handing more tickets to people after a rollout. The prompt, knowledge index and CRM adapter changed together, and the customer wants the model rolled back before the next support shift.
You have request traces and can restore individual parts of the system. Choose the checks that would locate the regression, then explain how each possible finding would affect containment and recovery.
What you'll practise
Tracing a failed resolution
Follow a ticket through retrieved policy, model output, CRM calls and its final state.
Choosing what to roll back
Use the evidence to distinguish a targeted reversal from a change that would leave the failure in place.
Explain which evidence you would inspect and what each result would change.