P69Model EvaluationAdvancedDesign18 min
Design Evaluation for a Rare-Event Classifier
Design rare-event classifier evaluation.
#design#rare events#precision recall
Scenario
Fraud prevalence is 0.7%; predicting no fraud is 99.3% accurate. Investigators review 150 alerts daily.
Problem statement
Design a credible evaluation plan.
Your Task
- Choose metrics.
- Select thresholds.
- Include capacity.
Related Concepts
PR curvePrevalence
Ready to count this problem?
Mark it complete when you have reasoned through the solution in your own words.