conditional entropy

noun

conditional entropy

noun
1

Computing, Engineering, Information theory, Mathematics, Natural sciences, Physical sciences, Sciences The portion of a random variable's own Shannon entropy which is independent from another, given, random variable.

  • The conditional entropy of random variable Y given X (i.e., conditioned by X), denoted as H(Y#124;X), is equal to H(Y)-I(Y#59;X) where I(Y#59;X) is the mutual information between Y and X.
Related terms
conditional probability

Entry derived from the Wiktionary, under licence CC BY-SA 4.0 — list of authors.