Relative entropy

The term relative entropy is used as a synonym for the following terms:

• Transinformation ( mutual information )
• Kullback-Leibler divergence

To avoid confusion, the term relative entropy should be avoided.

This is a disambiguation page for differentiating between several terms identified with the same word.