ASYMPTOTIC EQUIPARTITION PROPERTY

Specialty Definition: Asymptotic equipartition property

(From Wikipedia, the free Encyclopedia)

The asymptotic equipartition property (AEP) is a direct consequence of the weak law of large numbers and is used extensively in information theory. It can be summed up by the phrase 'Almost everything is almost equally probable.'

Given i.i.d random variables with entropy and the probability of observing the sequence , the AEP states that in all probability,

The AEP is used to define the typical set, which is used extensively in theories of compression.

Source: the above text is adapted by the editor from Wikipedia, the free encyclopedia under a copyleft GNU Free Documentation License (GFDL) from the article "Asymptotic equipartition property."

Top