Non Boolean Entropy
- If the target attribute can take on $c$ different values
we can still define entropy \[Entropy(S) \equiv \sum_{i=1}^c
-p_i\log_2p_i\]
- $p_i$ is the proportion belonging to class $i$.
- Now the entropy can be as large as $\log_2c$.
José M. Vidal
.
9 of 25