Entropy(H) and Info Gain

Equally likely – > Not predictable – > more surprise -> High entropy -> more information

Entropy.PNG

Info Gain:

InfoGain.PNG

 

Leave a Reply

%d bloggers like this: