P63Machine LearningAdvancedDesign18 min
Design a Group-Aware Validation Split
Design evaluation when entities have multiple rows.
#design#group validation
Scenario
Hospital visits from the same patient appear in both random train and validation splits, producing AUC 0.89.
Problem statement
Design realistic validation.
Your Task
- State the independence problem.
- Separate entities.
- Define generalization.
Related Concepts
Grouped splitsLeakage
Ready to count this problem?
Mark it complete when you have reasoned through the solution in your own words.