P61Feature EngineeringIntermediateDiagnose12 min

Diagnose Leakage From a Post-Outcome Feature

Identify a feature available only after the outcome.

#diagnose#leakage

Scenario

A Monday late-payment model includes collection_closed_reason, recorded after payment or write-off; AUC rises from 0.71 to 0.93.

Problem statement

Diagnose the timing failure.

Your Task

  1. Identify leakage.
  2. Explain inflated performance.
  3. Define a cutoff.

Related Concepts

LeakageValidation

Ready to count this problem?

Mark it complete when you have reasoned through the solution in your own words.