Perplexity

In information theory, perplexity is a measure of uncertainty for a discrete probability distribution. The perplexity of a fair coin toss is , and that of a fair die roll is ; and generally, for a probability distribution with exactly outcomes each having a probability of exactly , the perplexity is simply . But perplexity can also be applied to unfair dice, and to other non-uniform probability distributions. It can be defined as the exponentiation of the information entropy. The larger the perplexity, the less likely it is that an observer can guess the value which will be drawn from the dist