xAIVerified interview challenge
Measure an AI file-upload beta
Decide what evidence would justify expanding file uploads to every paid account.
Unlock with Full AccessThe challenge
A chat product is testing PDF, document and spreadsheet uploads with paid users in research, finance, operations and sales. After processing, the assistant can answer questions about a file and cite the passages it used.
At the beta review, the team could expand access, restrict particular file types or workflows, or pause for fixes. Define the scorecard that would support that decision across upload, processing and the user's eventual answer, with clear populations and denominators.
What you'll practise
Meaningful denominators
Define who and what each measure includes across the full upload-to-answer journey.
Expansion decisions
Connect outcomes and failure measures to the next release decision.
Define each measure and the decision it would support.