Everything2
Near Matches
Ignore Exact
Full Text
Everything2

Kolmogorov complexity

created by dg

(idea) by dg (11.4 mon) (print)   ?   (I like it!) Tue Sep 26 2000 at 4:23:41

The Kolmogorov complexity of a string of bits is the length of the smallest Turing machine program which produces the bit string as output. It is therefore somewhat dependent on one's choice of Turing machine, but since every Turing machine can be emulated by a universal Turing machine with a constant increase in program length this doesn't matter much.

-Back to the Transhumanist Terminology metanode


(thing) by enth (5.1 d) (print)   ?   (I like it!) 2 C!s Tue Oct 02 2001 at 18:54:55

Kolmogorov complexity is better described as the size of the algorithm needed to compute a given number. For the sake of comparison this is minimized -- the smallest possible algorithm is chosen for each computation to be measured. It's interesting because it describes the complexity of a number in a way that's completely independent from the number itself. Since it doesn't use any external measurements on the number, its much less prone to miscalculation than pattern-based methods of determining complexity. Also, a number doesn't even have to be computed to determine its Kolmogorov complexity, so its useful for comparing the complexities of huge numbers.

An often cited example is the comparison of a million digits of pi to a million statistically random digits. Pi has low Kolmogorov complexity as it can be specified by a short algorithm, whether it's Gauss's summation or one of the newer digit-specifying algorithms. On the other side of the spectrum, the million random digits can't be derived in any other way besides specifying them in their entirety. The algorithm used to compute pi doesn't change in size depending on how many digits are needed, it has a constant Kolmogorov complexity. Since the algorithm used to determine the random digits is in fact the digits themselves, it gets larger with each additional digit -- it has a linearly increasing Kolmogorov complexity. With this comparison we can tell that even though pi looks imposingly random to most methods of calculating complexity, it's much much less complex than a truly random number.

Also, modern measurements of Kolmogorov complexity don't necessarily use Turing machines at all. Since universal Turing machines are the common denominator of computation, they were used by Kolmogorov in his work. However, other ways of encoding algorithms, such as combinatory logic, are perfectly reasonable and have been successfully used for the purpose.


printable version
chaos

Transhumanist Terminology The Psychology of Randomness Kolmogorov-Arnold-Moser Theorem Universal Turing Machine
non-compressibility of random data How to solve any number sequence puzzle algorithmic information theory Turing Machine
combinator Fold Your Hands Child, You Walk Like a Peasant A random real is irrational Algorithm for calculating individual hexadecimal digits of pi
Teach Yourself Scheme: 14.4 Logic puzzles Algorithmic complexity Leonardo da Vinci Syndrome hypercomputation
The little grates at the top of my bedroom walls In Praise of Idleness infinity and human intuition pi
is pi normal? description number Everything Theory String
Y'know, if you log in, you can write something here, or contact authors directly on the site. Create a New User if you don't already have an account.
  Epicenter
Login
Password

password reminder
register

Everything2 Help

Cool Staff Picks
Look at this mess the Death Borg made!
War is peace, Freedom is slavery, Ignorance is strength
beige
fingernail
How Our Bodies Are Used--and Our Minds
On finding a wife
Time is money
How I invented Anna and made her a character in all my stories
I Enjoy Being a Girl
God
There are no good contraceptives
Sushi In Its Main Forms
Chocolate
The Healing Place
New Writeups
sam512
Moon Base Shackleton, 1978(fiction)
Pavlovna
toy boy(person)
XWiz
tear jerker(review)
Heitah
Anarchy is Order(idea)
jessicaj
July 26, 2008(dream)
Berek
ABBA(person)
devolution
k-hole(place)
Nadine_2
The Sound Of Madness(review)
Twin Eclipse
Conversations with God: An Uncommon Dialogue(idea)
SwimmingMonkey
Conversations with Fo Fo- the Loneliest dog in Purgatory(fiction)
locke baron
lynx(thing)
Simulacron3
Reality, Dimensions and the Natural Ontology(essay)
SubSane
Making Love to a 9-Foot Woman(person)
Ouzo
Thoughts(idea)
antigravpussy
I fall silent, listening. The breadcrumbs are talking about us(person)
Everything 2 is brought to you by the letter C and The Everything Development Company