P34Model EvaluationIntermediateChoose14 min
Choose a Precision-Recall Tradeoff
Choose an operating threshold for a review team with limited capacity.
#precision#recall#thresholds#fraud
Scenario
Fraud Model A has precision 0.91 and recall 0.42. Model B has precision 0.72 and recall 0.83. Analysts can review only 300 alerts per day.
Problem statement
Explain what additional information is needed before choosing a model or threshold.
Your Task
- Interpret both metric profiles.
- Connect precision to review workload.
- Connect recall to missed fraud and business cost.
Related Concepts
Operating thresholdsCapacity constraintsPrecision-recall curves
Ready to count this problem?
Mark it complete when you have reasoned through the solution in your own words.