Occam's Razor
- Occam's
razor: Prefer the simplest hypothesis that fits the
data.
- Why should we prefer a shorter hypothesis?
- There are fewer short hypothesis than long hypothesis so
- a short hypothesis that fits data unlikely to be
coincidence
- a long hypothesis that fits data might be coincidence.
- But, there are many ways to define small sets of hypothesis
- e.g., all trees with a prime number of nodes that use attributes
beginning with Z.
- What's so special about small sets based on size
of hypothesis?
José M. Vidal
.
16 of 25