P43Generative AI / RAGAdvancedDiagnose15 min
Evaluate a RAG Answer
Separate retrieval, generation, groundedness, and citation quality.
#rag#groundedness#hallucinations#evaluation
Scenario
Question: 'Can I expense economy baggage fees?' Policy A says they are reimbursable with a receipt. Policy B says business-class lounge access is not reimbursable. An answer says both are reimbursable and cites A.
Problem statement
Audit the answer and recommend a safe action.
Your Task
- Identify grounded and unsupported claims.
- Check citation support.
- Classify retrieval versus generation failure.
- Recommend review and improvement.
Related Concepts
GroundednessCitationsHuman review
Ready to count this problem?
Mark it complete when you have reasoned through the solution in your own words.