Amazingly, to a good approximation it is equal to the entropy of the distribution p1,…,pk, a well-known function from information theory that is known to measure the information content of ...Amazingly, to a good approximation it is equal to the entropy of the distribution p1,…,pk, a well-known function from information theory that is known to measure the information content of a random variable.