Entropy

Entropy[list]
gives the base information entropy of the values in list.

Entropy[k, list]
gives the base k information entropy.

Details and OptionsDetails and Options

  • Entropy[string] computes the information entropy of the characters in string.
  • Entropy can handle symbolic data.
  • With the option setting SameTest->f, Entropy[list, ...] applies f to pairs of elements in list to determine whether they should be considered equivalent.
  • The default setting for SameTest is SameQ.

ExamplesExamplesopen allclose all

Basic Examples (4)Basic Examples (4)

Entropy of a list of data:

In[1]:=
Click for copyable input
Out[1]=

Entropy of a symbolic list:

In[1]:=
Click for copyable input
Out[1]=

Entropy of a string:

In[1]:=
Click for copyable input
Out[1]=
In[2]:=
Click for copyable input
Out[2]=

Entropy of a random list of zeros and ones:

In[1]:=
Click for copyable input
Out[1]=
In[2]:=
Click for copyable input
Out[2]=
New in 7
New to Mathematica? Find your learning path »
Have a question? Ask support »