Information Theory

Shannon set meaning aside on purpose, and communication engineering was better for it. Knowledge systems cannot set it aside: for them, preserving meaning is the whole problem.

Information theory studies how information is transmitted, preserved, and degraded within complex systems. It is a useful lens for how meaning and reasoning drift, fragment, or become difficult to reconstruct over time. In this research programme's own terms, Interpretive Entropy is the general condition underneath most of what follows on this page.

One scoping note before the argument, because specialists will want it. Interpretive entropy is a semantic-level concept, used by analogy with Shannon's. It is not Shannon entropy, and this page does not claim to measure it in bits.

Information, Signal, and Entropy

Claude Shannon's work introduced entropy as a measure of uncertainty in communication systems. As information passes through a channel, noise and distortion degrade the signal, so communication systems need mechanisms that preserve signal integrity and let the receiver recover what was sent.

Shannon was explicit that the meaning of a message lies outside this engineering problem. That was a deliberate and productive choice. It is also the gap this programme works in, because the same principles apply to knowledge systems, institutions, and collaborative reasoning, where what has to survive is not only the signal but what it meant.

Meaning Degradation in Knowledge Systems

As knowledge systems grow, concepts are reused, reinterpreted, and extended across contexts. Over time the relationship between the original meaning of an idea and its later interpretation becomes less clear.

PKOS describes this phenomenon as interpretive entropy: the divergence between original semantic intent and later operational interpretation. When it increases, reconstructing the reasoning behind earlier decisions becomes increasingly difficult.

The programme treats it as a condition with a real shape, not a vague drift. It begins with Ephemeral Processing, where a single interaction's reasoning fails to persist. It compounds into Reasoning Fragmentation as that happens repeatedly. If unaddressed, it ends in Interpretive Collapse, where the reasoning is gone entirely and only interpretation remains. Its counterpart on the other side is Navigational Coherence, the name for what has to be actively maintained to avoid the whole progression.

Reconstruction Cost

In complex systems, the effort required to reconstruct reasoning lineage becomes significant. Researchers, policymakers, and collaborators ask why a decision was made or how an idea developed. If the reasoning trajectory was not preserved, answering requires piecing together fragments from documents, conversations, and incomplete records.

PKOS calls this burden reconstruction cost. As systems grow in scale and complexity it rises until collaboration becomes fragile or slow, and, left unaddressed long enough, it terminates in Reconstruction Bankruptcy: a system spending more capacity reconstructing understanding than it generates in value.

Semantic Surface Area

Information theory also shows how complexity increases as systems accumulate information. PKOS introduces semantic surface area for the total network of concepts, definitions, dependencies, and interpretations in a knowledge system. As it expands, the risk of drift, ambiguity, and unintended interpretation grows with it, and without stabilising structure, meaning becomes increasingly difficult to maintain across time.

Preserving Signal in Reasoning Systems

Information systems address entropy with mechanisms that preserve signal integrity: encoding strategies, redundancy, and error correction. Reasoning systems need analogous mechanisms to preserve the integrity of meaning across time. Structured reasoning artifacts, semantic scaffolds, and preserved reasoning trajectories are this programme's version of them. They stabilise reasoning so that it stays reconstructable as complexity grows.

Information Preservation and Cumulative Reasoning

When reasoning trajectories remain visible and interpretable, a knowledge system can extend prior reasoning instead of reconstructing it from fragments. Earlier reasoning stays accessible, and later participants can examine, critique, and extend it across time. At the economic level, this is the mechanism the programme calls Continuity Capital. For reasoning, preservation plays the part that error correction plays in a communication system: it keeps meaning intact as complexity grows.

The Formal Treatments

Where This Stands

This is independent research. The mechanisms described here exist as working infrastructure. What has not yet had proper testing is whether they preserve meaning as well as the argument claims, and how that should be measured. That is the empirical question this programme wants answered with partners. The most useful thing anyone from this field could tell us is where the analogy to coding holds and where it breaks.

→ Contact
→ The sibling question, from the side of regulation and feedback: Systems View

Shannon's most hopeful result was that noise does not make reliable communication impossible: with the right structure, errors can be corrected. Meaning is not a channel in his sense, and the analogy has limits. The lesson still carries over. Degradation is not fate when structure is added on purpose.