Inductive Bias
- Given a set of examples there are many trees that would
fit it. Which one does ID3 pick?
- This is the inductive bias.
- Approximate ID3 inductive bias: Prefer shorter
trees.
- To actually do that ID3 would need to do a BFS on tree
sizes.
- Better ID3 inductive bias: Prefer shorter trees over
longer trees. Prefer trees that place high information gain
attributes near the root.
José M. Vidal
.
14 of 25