In what ways has the concept of information as negative entropy been misinterpreted?

The equations describing information in classical information theory have obvious similarities to equations describing entropy in thermodynamics. Von Neumann was said to have pointed this out to Shannon.

The similarity has led some to think of information as entropy with a minus sign, and to consider it a kind of anti-disordering effect.

Equating entropy with "disorder" is somewhat inaccurate, however, and thinking of information as being an ordering effect risks invoking a fictional force.

Michael Webb, 2001

home ]