Kolmogorov-Sinai entropy

…was the development of the Kolmogorov-Sinai entropy. In collaboration with Kolmogorov, he built upon the work of American engineer Claude Shannon, who developed a measure of the efficiency of a communications system, called the entropy, that is computed on the basis of the statistical properties of the message source. (In…