Tag Archives: information theory

Revising Zipf’s law [From PNAS]

Posted on March 3, 2011 by Daniel Martin Katz

From the Abstract: “We demonstrate a substantial improvement on one of the most celebrated empirical laws in the study of language, Zipf’s 75-y-old theory that word length is primarily determined by frequency of use. In accord with rational theories of … Continue reading →

Posted in Uncategorized | Tagged , | Leave a comment

Claude Shannon – Father of Information Theory

Posted on June 17, 2010 by Daniel Martin Katz

This summer in the Complex Systems Advanced Academic Workshop we are devoting attention to information theory.  In collecting some materials about Claude Shannon, I came across the above video and thought I would share it with others.  Here is the … Continue reading →

Posted in Uncategorized | Tagged , , | Leave a comment

A Quantum Calculation: Is Information at the Root of Everything?

Posted on April 25, 2010 by Daniel Martin Katz

From the article “… Vlatko Vedral, an Oxford physicist, examines the claim that bits of information are the universe’s basic units, and the universe as a whole is a giant quantum computer. He argues that all of reality can be … Continue reading →

Posted in Uncategorized | Tagged , , | Leave a comment