CAS I: A Geometric Coding Theorem Romie Banerjee July 16, 2026 Abstract
arXiv:2607.13796v1 [cs.IT] 15 Jul 2026
This paper establishes a direct analogue of the classical Coding Theorem in the setting of symmetry groups. We consider computable bijections on the set of binary strings—called symmetries—and define the symmetry prior of a string x as the probability that a randomly chosen symmetry from a given group G has x as its unique fixed point. We show that for any fix-retractable symmetry group G—a group admitting a computable section that selects an isolating symmetry for every string—the symmetry prior is a universal lower semi-computable semi-measure. In this case, the Geometric Coding Theorem holds: − log2 mG (x) = K(x) + O(1) where K(x) is the prefix Kolmogorov complexity of x. We also develop a Galois connection between subgroups of G and subsets of binary strings, characterizing closed points and maximal closed subgroups, and explore the join-semilattice of dense subgroups. Our results unify algorithmic information theory with group theory and provide a framework for studying symmetry-induced complexity measures. This paper is the first in a series on Computational Algorithmic Statistics (CAS). Keywords: Kolmogorov complexity, Solomonoff prior, algorithmic probability, coding theorem, symmetry groups, Galois connections
1
Introduction
1.1
Program-Size Complexity
The concept of algorithmic complexity defined by Solomonoff, Kolmogorov, Chaitin and Levin is a measure that quantifies the algorithmic randomness of a binary string. Formally, the algorithmic complexity, denoted by K of a binary string x is the length of the shortest computer program p running on a universal Turing machine U that generates the string x as an output and halts [[1] Ch. 2]. KU (x) = min{ℓ(p) | U (p) = x}
(1)
The invariance theorem says that the definition of K above is independent of the choice of the universal Turing machine U . For a a different choice V , the K values differ by a constant term independent of x. The constant term comes from the cost of simulating U by V and vice-versa. The function K that takes in x and gives the length of the shortest program producing x is uncomputable. This is due to the halting problem, given that one cannot always find the shortest problem in finite time without having to run all programs. This means having to wait forever in case they never halt. The function K is however upper semi-computable, i.e. it can approximated from above by computable functions. This is because the set of computer programs that output x and halt is recursively enumerable.
1.2
Algorithmic Probability
The ordinary probability of production of a binary string x among all possible 2n strings of length n is given by P (x) = 1/2n . The concept of algorithmic probability replaces the random production of outputs with the random production of programs that produce the output. The algorithmic probability (or Solomonoff prior or Levin’s semi-measure) m(x) of a binary string x is the sum over all prefix-free programs p for which a universal Turing prefix machine U running p outputs x and halts. The replaces the length of x with the length of the program p that produces x. It
1
is thus a measure that estimates the probability of a random program p producing x when run on U . [[1] Ch. 3] X 1 (2) mU (x) = ℓ(p) 2 p|U (p)=x
The algorithmic probability is independent of the choice of universal prefix machine (up to a constant term) and as a function from binary strings to R is lower semi-computable.
1.3
Coding Theorem
There is a direct and miraculous connection between the algorithmic complexity and algorithmic probability of binary strings. The negative logarithm of the algorithmic probability − log2 mU (x) gives a complexity measure. By this measure the complexity of a string is directly related to the frequency of production of the string in a universal prefix machine. More programs imply lower complexity. This is related to the algorithmic complexity as the shortest program producing x on U will contribute to the largest term contributing to mU (x). The inequality − log2 mU (x) ≤ KU (x) is obvious. The algorithmic coding theorem says that something much stronger is true. Theorem 1.1 ([1] Thm.4.3.3 ). The algorithmic coding theorem, KU (x) = − log2 mU (x) + O(1)
(3)
The theorem establishes that, if there are many programs producing a string then there is also a short program producing the string ; and strings of lower frequency have higher Kolmogorov complexity. The key idea behind the proof comes down to the observation that if there are k prefix programs of length n producing x on U , then there is a prefix program of length n − log2 k + O(1) that produces x on U . There is another way of state the coding theorem. The semi-measure on bit strings defined by P (x) = 1/2K(x) is a universal lower semi-computable semi-measure.
1.4
Geometric Coding Theorem
A symmetry is a computable bijection of the set of binary strings. If a symmetry has a string x as its only fixed point, it can be framed as program that produces the string x and halts. Q: Do the frequency of symmetry programs producing x have a direct relationship with the Kolmogorov complexity of x in the same way the frequency of ordinary programs does (via the classical coding theorem)? Let the symmetry prior be the probailiy of producing a bit string by randomly selecting a symmetry program. The symmetry prior mU G (x) of a bit string x is the sum over all prefix-free programs symmetry programs p for which a universal Turing prefix machine U G running p outputs x and halts. mU G (x) =
X p|U G (p)=x
1 2ℓ(p)
(4)
In this paper we lay down a condition on the group of symmetries so that the coding theorem with the symmetry prior is true. Theorem 1.2. Let G be a group of computable bijections of {0, 1}∗ with following property: there exists a subgroup H ≤ G which can isolate all bit strings and the symmetries H and isolating symmetries IH are recursively enumerable. Then the following (equivalent) statements are true: 1. KU (x) = − log2 mU G (x) + O(1). U ∗ 2. The symmetry prior dominates the Solomonoff prior: ∃C s.t C.mU G (x) ≥ m (x), ∀x ∈ {0, 1} .
3. The symmetry prior is a universal lower semi-computable semi-measure on finite bit strings
2
1.5
Results Dependencies ∃H ≤ G | H, IH r.e. ks
Thm.2.7+3
G fix-retractable 2.4 %
(5)
Thm.2.6
U G simulates U 2.5
LSC
qy
2
Coding with symmetries
2.1
Symmetries
Thm.3.3
Thm.3.5
GCT 1.2
The set of total recursive functions {0, 1}∗ → {0, 1}∗ is denoted by T. The group of total recursive bijective functions is denoted TB. Elements of TB are called symmetries. T = {f : {0, 1}∗ → {0, 1}∗ | f (x) halts ∀x}
(6)
TB = {f ∈ T | f is a bijection}
(7)
∗
Given x ∈ {0, 1} , the set of symmetries that fix x is a subgroup of TB denoted by stab(x). stab(x) = {f ∈ TB | f (x) = x} ≤ TB
(8)
A symmetry f ∈ stab(x) isolates x when x is the only fixed point of x. The set of isolating symmetries for x is denoted by Ix . I(x) = {f ∈ TB | f (x) = x and f (y) ̸= y, ∀y ∈ {0, 1}∗ } ⊆ stab(x)
(9)
Let I denote the set of all isolating symmetries in TB. I = {f ∈ TB | |fix(f )| = 1} =
a
I(x)
(10)
x∈{0,1}∗
Let G ≤ TB be a subgroup of total bijections of {0, 1}∗ . Subgroups of TB will be called symmetry groups. Given x ∈ {0, 1}∗ , the elements of G that fix x, stabG (x) = {g ∈ G | g(x) = x} ≤ G
(11)
The set of isolating symmetries in G for x is denoted by IG (x). I(x) = {g ∈ G | g(x) = x and g(y) ̸= y, ∀y ∈ {0, 1}∗ } ⊆ stabG (x)
(12)
The set of all isolating symmetries in G is denoted IG . IG = {g ∈ G | |fix(g)| = 1} =
a
IG (x)
(13)
x∈{0,1}∗
2.2
Algorithmic properties of symmetry groups
The group of total recursive bijections TB is not r.e.. To enumerate all computable bijections, one needs to enumerate all programs that compute total bijective functions. This requires checking totality and bijectivity, which are Π2 -complete. Since TB is not r.e., there is no effective enumeration of stab(x) either. If we make the assumtion however that G is a r.e. subgroup of TB, the stabiliser group stabG (x) is r.e. One can enumerate through G and check if g ∈ G fixes x, provided that the action of the group on bit strings is computable . Under the assumption that G is r.e., the subset IG (x) is co-r.e. To enumerate Ix , one would enumerate elements of stabG (x) to check that they have no fixed points other than x. This is a co-r.e. condition (finding the second fixed point is r.e., proving none exists is co-r.e.). 3
Proposition 2.1. Let G be a r.e. symmetry group. Then for all x ∈ {0, 1}∗ , the stabilizer subgroups stabG (x) are r.e. The point-wise isolators and total isolator IG (x) and IG are co-r.e. A prefix universal computer is a partial recursive function U : {0, 1}∗ × {0, 1}∗ → {0, 1}∗ so that U (p, x) = y where p is prefix-free code for the function U (p, ·) : {0, 1}∗ → {0, 1}∗ . A program encoding a symmetry is a prefix code p so that U (p, ·) is a symmetry. We call this a symmetry program. The set of all symmetry programs is denoted by U TB . U TB = {p | U (p, ·) ∈ TB}
(14)
TB
By the discussion there U is not a recursively enumerable language. Let G ⊂ TB be a r.e. subset. The set of symmetry programs for symmetries in G U G = {p | U (p, ·) ∈ G}
(15)
is r.e. Let us denote the universal computer for G-symmetries by the same name. Proposition 2.2. Let G be a r.e. symmetry group. There is an effective enumeration of G-symmetries. The universal computer for this is a p.r. function U G : {0, 1}∗ × {0, 1}∗ → {0, 1}∗
(16)
such that U G (p, ·) ∈ G when p is halting. A symmetry program computes x when it is a program for an isolating symmetry for x. The set of all symmetry programs computing x is denoted by UxTB . UxTB = {p | U (p, ·) ∈ Ix }
(17)
The set of all symmetry programs in U G computing x is denoted by UxG . UxG = {p | U G (p, ·) ∈ Ix }
(18)
Remark 2.3. Note that U TB is not a universal computer for total recursive bijections. The set TB is not recursively enumerable. There is no Turing machine that accepts only the symmetry prefix programs in U.
2.3
Simulations
The fixed-point set of computable symmetries offers a mapping from G ≤ TB to subsets of bit strings G → P({0, 1}∗ ). This is non-computable in general. Restriction to isolating symmetries gives a computable map, fix : IG → {0, 1}∗ . (19) Definition 2.4. An I-section of G ≤ TB is a computable right-inverse of fix, i.e. a computable map sec : {0, 1}∗ → IG
(20)
such that fix ◦ sec = id{0,1}∗ . The existence of the section means IG (x) is non-empty ∀x ∈ {0, 1}∗ . A symmetry group G is fix-retractable if it admits an I-section. The existence of a I-section implies an important property of the program spaces. Any ordinary program for outputting a bit string can be simulated by a symmetry program of the same length (up to additive constant term). The fix map implies a similar property in the other direction, any symmetry program that isolates a bit string can be simulated by an ordinary program of the same length (up to a additive constant). The idea of codes being simulatable by codes of another type of the same length is formalized in the definition below. The subsequent proposition proves the connection claimed. Definition 2.5. U G simulates U if there is a injective computable function Φ : {0, 1}∗ → {0, 1}∗ that maps programs computing x to symmetry programs computing x. Φ(Ux ) ⊂ UxG , ∀x ∈ {0, 1}∗
(21)
and ℓ(Φ(p)) = ℓ(p) + O(1) for all p ∈ Ux . U simulates U G if there is a injective computable function Ψ : {0, 1}∗ → {0, 1}∗ that maps symmetry programs to programs computing x Ψ(UxG ) ⊂ Ux , ∀x ∈ {0, 1}∗ and ℓ(Ψ(q)) = ℓ(q) + O(1) for all q ∈ UxG . 4
(22)
Theorem 2.6. If G is a fix-retractable symmetry group, then U and U G can simulate each other. Proof. 1. (U simulates U G ): The map fix : IG → {0, 1}∗ lifts to a computable map between program spaces: Ufix : {q | U G (q) halts and ∈ IG } → {p | U (p) halts } (23) such that ∀x ∈ {0, 1}∗ , Ufix (UxG ) ⊂ Ux . The mapping Ufix is defined as follows: given a program q for an x-isolator, run q, get the isolator g ∈ IG (x), compute the fixed point by computing g(x) through enumerating x ∈ {0, 1}∗ . This will stop eventually because g is an isolator for x. The program Ufix (q) is therefore a program that produces x. The prefix code for Ufix (q) is obtained by concatenating the prefix code with q with the code for Ufix plus a constant overhead code. This is injective and the length, ℓ(Ufix (q)) ≤ ℓ(q) + O(1). (24) 2. (U G simulates U ): The section sec : {0, 1}∗ → IG lifts to a computable map between program spaces: Usec : {p | U (p) halts } → {q | U G (q) halts and ∈ IG } (25) such that ∀x ∈ {0, 1}∗ , Usec (Ux ) ⊂ UxG . The mapping Usec is defined as follows: given a program p that produces x, run p, get x, apply sec to get sec(x) ∈ IG (x). The program Usec (p) is program for an isolator for x by concatenating the prefix code for p with the constant length prefix code for Usec . This makes Usec injective and the length, ℓ(Usec (p)) ≤ ℓ(p) + O(1).
(26)
We give an alternate characterization of fix-retractable symmetry groups. The presence of an Isection implies and is implied by the existence of a subgroup of G which is r.e. and for which the set of isolators is also r.e. Theorem 2.7. The following properties of a symmetry group G ≤ TB are equivalent. 1. G is fix-retractable 2. ∃H ≤ G such that (a) H can isolate all x ∈ {0, 1}∗ (b) H and IH are r.e. Therefore for a symmetry group G satisfying 2, U G can simulate U . Proof. 1. (⇐) Let U H and U IH be effective enumerations of H and IH . Define the I-section of G, sec : {0, 1}∗ → IG as follows: Enumerate isolators in H by running U IH . For every h ∈ IH check if it belongs to IH (x) by computing h(x). This will eventually halt because of the first assumption about H. 2. (⇒) Let sec : {0, 1}∗ → IG be an I-section for G. Consider the induced map on programs (see proof of 2.6) Usec : {p | U (p) halts } → {q | U G (q) halts and ∈ IG } (27) which satisfies sec(Ux ) ⊆ UxG for all x ∈ {0, 1}∗ . Consider the set of isolators in G defined by the image of sec: S = {U (q, ·) | q ∈ sec(Ux )} ⊆ IG (x) Let H := ⟨h : h ∈ S⟩ be the subgroup of G generated by S.
5
(28)
3
Algorithmic Probability from Symmetries
3.1
Symmetry Priors
Definition 3.1. The G-symmetry prior of a string x with respect to a computer U is the probability that a random symmetry program computes x. X 1 (29) mU G (x) = 2ℓ(p) G p∈Ux
The Solomonoff Prior mU (x) is lower semi-computable. The proof relies on the fact that the set of programs Ux is recursively enumerable. The direct analogy fails to work with the symmetry prior since the set of symmetry programs computing x is not r.e. In the sequel we show that the symmetry prior is equal to the Solomonoff prior up to a constant term when every program can be simulated by a symmetry program. But first, we have to make the idea of simulation precise.
3.2
Universal Semi-measures
Definition 3.2. A function µ : {0, 1}∗ → R is a probability semi-measure if 1. µ(ϵ) ≤ 1 2. µ(x) ≥ µ(x0) + µ(x1) A semi-measure is lower semi-computable if the function µ is lower semi-computable. Let M be a class of discrete semi-measures. A semi-measure P0 is universal (or maximal) for M if P0 ∈ M, and for all P ∈ M there exists a constant cP such that for all x ∈ {0, 1}∗ we have cP P0 (x) ≥ P (x), where cP possibly depends on P but not on x. The Solomonoff prior mU (x) and 2−K(x) are lower semi-computable semi-measures. The condition of being semi-measures is a consequence of teh Kraft inequality of prefix codes. Lower semi-computability of both semi-measures come from the fact that Ux is recursively enumerable. The prior mU (x) is universal for the following reason. For any lower semi-computable semi-measure µ, there is a computable enumeration of programs that realize µ. The universal machine U can simulate all such programs. The sum mU (x) includes all programs, so it dominates each µ up to a constant (the weight assigned to the program that enumerates µ). The classical coding theorem implies that 2−K(x) is universal: since mU (x) ≍ 2−KU (x) , and mU (x) is universal, 2−KU (x) inherits universality. Proposition 3.3. If G is fix-retractable, the symmetry prior mU G (x) is a lower semi-computable semimeasure. Proof. Compose the two simulations Θ := sec ◦ fix : UxG → UxG
(30)
This map takes any symmetry program p ∈ UxG , converts it into a standard program fix(p) and converts it back into a symmetry program sec(fix(x)). The length of the program Θ(p) is no longer than p by a constant term ℓ(Θ(p)) = ℓ(sec(fix(p)) ≤ ℓ(p) + cΨ + cΦ (31) Let Sx = Θ(UxG ) ⊆ UxG be the set of symmetry programs that are in the image of Θ. Two important properties of Sx : 1. Sx is recursively enumerable. This is so because Ux is recursively enumerable and Φ is a computable map. Therefore Sx is the image of a r.e set under a computable map. 2. Sx is probability dense in UxG . X q∈Sx
1
≥ 2ℓ(q)
X 2 G
1
= 2−cθ ℓΘ(p)
p∈Ux
1 = 2−Θ mU G (x) ℓ(p) 2 G
X
p∈Ux
So Sx carries a constant fraction of the total probability mass of UxG . 6
(32)
To approximate the symmetry prior from below we only need to enumerate a probability-dense r.e. subset Sx ⊆ UxG . Since Sx is r.e., we can enumerate its elements and sum their probabilities, giving a non-decreasing sequence that converges to the value at least 2−cΘ mU G (x). The proof of lower semi-computability of the symmetry prior 3.3 inspires the following definition. Definition 3.4. For every x ∈ {0, 1}∗ , let Cx be a set of codes with prefix-free encoding and a probability semi-measure µ. A subset Dx ⊆ Cx is called uniformly probability dense if: 1. Dx is recursive enumerable 2. There exists a constant c > 0 such that µ(Dx ) ≥ c.µ(Cx ) for all x. In the context of symmetry programs, Cx = UxTB , and a uniformly probability-dense subset Sx ⊂ UxTB provides a lower semi-computable approximation to the symmetry prior mU G (x). Theorem 3.5. If G is a fix-retractable symmetry group then the symmetry prior is equal to the Solomonoff prior up to a multiplicative constant. U mU G (x) ≍ m (x).
(33)
Therefore, the symmetry prior is a universal lower semi-computable semi-measure on binary strings. Also as a consequence of the classical coding theorem − log2 mU G (x) = K(x) + O(1)
(34)
Proof. U 1. (mU G (x) ≥ C.m (x))
From the simulation sec : U → U G , every program p for x gives a symmetry program sec(p) with ℓ(sec(p)) = ℓ(p) + c1 , where c1 is the constant overhead of the simulation. Therefore: mU G (x) =
1
X X 1 1 −c1 ≥ = 2 = 2−c1 mU (x) ℓ(sec(p)) ℓ(p) 2ℓ(p) 2 2 G p∈U p∈U
X
p∈Ux
x
(35)
x
2. (mU (x) ≥ C.mU G (x)) From the simulation fix : UxG → Ux , every symmetry program q for x gives a program fix(q) for x with ℓ(fix(q)) = ℓ(q) + c2 where c2 is the constant overhead of the simulation fix. Therefore: mU (x) =
X p∈Ux
3.3
Examples
3.3.1
G = TB
1 2ℓ(p)
≥
1
X q∈UxG
2ℓ(fix(q))
= 2−c2
X q∈UxG
1 2ℓ(q)
= mU G (x)
(36)
Theorem 3.6. [2] TB is fix-retractable. Hence the GCT is true for the full symmetry group of all computable symmetries. Proof. An I-section of TB would be a computable map sec : {0, 1}∗ → I such that sec(x) ∈ Ix . We give an explicit construction. For every x ∈ {0, 1}∗ let sx be a x isolator defined as follows: 1. sx (x) = x 2. sx (x∗ ) = ϵ and sx (ϵ) = x∗ 3. ∀y ̸= x, sx (y) = y ∗ , where y ∗ is y with its last bit flipped. The mapping x 7→ sx is computable.
7
4
Algebraic Characterizations
4.1
Galois Connections
Let G ≤ TB be a symmetry group. Definition 4.1. The stabilizer of a subset X ⊂ {0, 1}∗ is the subgroup of G that fixes X stab(X) = {f ∈ G | X ⊂ fix(f )}
(37)
The fixed points of a subgroup H ≤ G is fix(H) = {x ∈ {0, 1}∗ | h(x) = x∀h ∈ H}
(38)
(fix, stab) : L(G) → P ({0, 1}∗ )
(39)
Theorem 4.2. The pair forms an order-reversing Galois connection between the the subgroup lattice of G and the subset lattice of {0, 1}∗ . That is for every H ≤ G and X ⊂ {0, 1}∗ X ⊂ fix(H) ⇐⇒ H ≤ stab(X)
(40)
Definition 4.3. (Closure Operations) Composing the left and right adjoints of the Galois connection gives closure operations. 1. On subsets of {0, 1}∗ X := fix(stab(X)) ⊇ X
(41)
H := stab(fix(X)) ≥ H
(42)
2. On subgroups of G These are closure operations in the sense they are monotone and idempotent, and are guaranteed by the Galois connection. A subset X ⊆ {0, 1}∗ or subgroup H ≤ G is closed when its closure is itself. A point x ∈ {0, 1}∗ is said to be closed when {x} is closed. The closure of x is the intersection of the fixed points sets of all the elements of G that fix x. \ {x} = fix(⟨f ⟩)
(43)
f (x)=x
Proposition 4.4. A symmetry group G can isolate every x ∈ {0, 1}∗ if and only if every maximal subgroup of G is closed in L(G) Proof. A point x is closed i.e. fix(stab(x)) = {x} iff IG (x) ̸= ∅. The Galois connection of Thm.4.2 implies there is a order reversing bijection between closed sets in {0, 1}∗ and closed subgroups in G given by X ←→ stab(X) and H ←→ fix(H). i.e. the closed subgroups are precisely the subgroups of the form stab(X) for some subset X ⊆ {0, 1}∗ . The maximal closed subgroups are stab(x) for some x ∈ {0, 1}∗ . The closed points of {0, 1}n are therefore in one-to-one correspondence with maximal closed subgroups of G. Proposition 4.5. Given a symmetry group G, the set of isolating symmetries IG can be identified with the minimal (w.r.t lattice) points in the join semi-lattice of dense subgroups of G. Proof. For any closed bit string x ∈ {0, 1}∗ let stab(x) ≤ G be the corresponding maximal closed point in the lattice L(G). The elements of stab(x) fix x, but are not necessarily isolators of x. We can characterize the isolators subset IG (x) ⊆ stab(x) in the following way: A dense point below stab(x) is a subgroup D ≤ stab(x) such that D = stab(fix(D)) = stab(x). Dense points are those subgroups of stab(x) whose fixed points set is {x}. The join of two dense subgroups is dense, fix(⟨D1 , D2 ⟩) = fix(D1 ) ∩ fix(D2 ) = {x} (44) Therefore the set of dense subgroups of stab(x) forms a join semi-lattice, denote this by D(x). The lowest points of this semi-lattice are cyclic groups generated by isolators of x. The cyclic subgroups 8
⟨g⟩ : g ∈ IG (x) are the principal dense subgroups. The stabilizer stab(x) can be constructed as the join of all the cyclic dense subgroups _ ⟨g⟩ = stab(x) (45) g∈IG (x)
Theorem 4.6. Let G be a symmetry group. The conditions of Thm.2.7(2) are satisfied if 1. ∃H ≤ G such that H is closed in L(G) and every maximal subgroup of H is closed in L(G) 2. the subgroup lattice L(H) is computable (i.e. the points in the lattice, join, meet and closure operations are computable)
5
Conclusion
We have established a direct analogue of the classical Coding Theorem in the context of symmetry groups. The central notion of a fix-retractable symmetry group—one that admits a computable section selecting an isolating symmetry for every string—provides the precise condition under which the symmetry prior mU G (x) becomes a universal lower semicomputable semimeasure. When this condition holds, the Geometric Coding Theorem − log2 mU G (x) = K(x) + O(1) follows, extending Solomonoff’s celebrated result to the realm of algorithmic symmetry. The Galois connection between subgroups of G and subsets of binary strings reveals a rich algebraic structure: closed points correspond to maximal closed subgroups, and the join-semilattice of dense subgroups offers a natural framework for understanding how isolating symmetries generate the full stabilizer. The results presented here form the foundation for the broader program of Computational Algorithmic Statistics (CAS).
References [1] Ming Li and Paul M. B. Vitányi. An Introduction to Kolmogorov Complexity and Its Applications. Springer, 4th edition, 2019. [2] Raúl A. Trejo, Vladik Kreinovich, and Luc Longpré. Choosing a Physical Model: Why Symmetries? Bulletin of the European Association for Theoretical Computer Science (EATCS), vol. 70, pp. 159–161, 2000. Also available as UTEP technical report UTEP-CS-00-04.
9