How did Gregory Chaitin, Andrey Kolmogorov, and Raymond Solomonoff contribute to algorithmic information theory?
The x-, y-, and z-axes correspond to components of the weather, while the graph indicates feasible weather patterns. The graph is a function of time, which means, in theory, that tracing the curve in one direction reveals past weather patterns, while tracing the curve in the other direction predicts future weather patterns. However, practically indistinguishable points may lead to completely different weather epochs, indicated by the two distinct “lobes.” This phenomenon, known as sensitivity to initial conditions, is what prevents precise weather forecasts more than a few days into the future.
In the 1960s, Gregory Chaitin, Andrey Kolmogorov, and Raymond Solomonoff independently began formulating an objective measure for the intrinsic complexity of information, which laid the foundation for what is now known as algorithmic information theory (AIT).
Their collective work established the core principle of AIT: defining the complexity of a message or object as the length of the shortest algorithm—or step-by-step procedure—required to reproduce it.1
While all three were instrumental in the theory's inception, Gregory Chaitin, a research scientist at IBM, is credited with developing the largest body of work and refining these initial concepts into the formal, structured theory recognized today. Andrey Kolmogorov, a prominent Russian mathematician, contributed to this field as part of his broader, extensive research into information theory, automata theory, and the theory of algorithms during the 1960s.12