P68Model EvaluationAdvancedInterpret13 min
Interpret a Miscalibrated Probability Model
Compare predicted buckets with observed frequencies.
#calibration#interpretation
Scenario
Of 100 accounts near 0.20, 18 default; near 0.50, 52 default; near 0.80, 58 default.
Problem statement
Assess calibration.
Your Task
- Compare buckets.
- Identify confidence error.
- Choose next check.
Related Concepts
Reliability curvesRisk
Ready to count this problem?
Mark it complete when you have reasoned through the solution in your own words.