Reduced-Error Pruning

• Split data into training and validation sets.

1. Do until further pruning is harmful:
   1. Evaluate impact on validation set of pruning each possible node (plus those below it)
   2. Greedily remove the one that most improves validation set accuracy

• Produces smallest version of most accurate subtree.
• Requires that a lot of data be available.