4 Jan
2014
4 Jan
'14
1:25 a.m.
John R Pierce wrote:
Entropy has a standard meaning in computer science, see http://en.wikipedia.org/wiki/Information_entropy for an introductory discussion with various references.
Shannon entropy only makes sense when applied to a random variable. It cannot be applied to a single string, as in this case.
Algorithmic entropy (Kolmogorov complexity) can be applied to a single string, but it cannot be measured directly.
--
Timothy Murphy
e-mail: gayleard /at/ eircom.net
School of Mathematics, Trinity College, Dublin 2, Ireland