Source tropy

Quellentropie ( English source entropy ) is a term from the stochastics .

The definitions of block entropy and conditional entropy are equivalent in the border crossing . An expression is obtained that describes the entropy per symbol independently of the block length, the so-called source tropy:

${\displaystyle h=\lim _{n\to \infty }H^{(n)}=\lim _{n\to \infty }h_{n}}$

The inequalities apply

${\displaystyle h\leq H^{(n)}\leq H(x_{n})\leq \log |X|}$

literature

• Hans Weinrichter, Franz Hlawatsch: Stochastic basics of telecommunications signals. Springer Verlag, Vienna 1991, ISBN 978-3-211-82303-3 .

Web links

• INTRODUCTION TO INFORMATION AND CODING THEORY with comments on CRYPTOLOGY (accessed on February 23, 2018)
• Introduction to Telecommunications, p. 57 (accessed on February 23, 2018)