Entropy and information

The term entropy is often avoided because it contains a certain complexity that cannot be argued away. But when we talk about information, we also have to talk about entropy. Because entropy is the measure of the amount of information. We cannot understand what information is without understanding what entropy is. Information is always relative We believe that we can pack information, just as we store bits in a storage medium. Bits are then the information that is objectively available, like little beads in a chain that can say yes or no. For us, this is information. But this image is

By |2025-12-03T14:54:11+00:0011. September 2024|Categories: Information|Tags: , , , , , |0 Comments

Georg Spencer-Browns Distinction and the Bit

continues paradoxes and logic (part 2) History Before we Georg Spencer-Brown's (GSB's) distinction as basic element for logic, physics, biology and philosophy, it is helpful to compare it with another, much better-known basic form, namely the bit. This allows us to better understand the nature of GSB's distinction and the revolutionary nature of his innovation. Bits and GSB forms can both be regarded as basic building blocks for information processing. Software structures are technically based on bits, but the forms of GSB (‘draw a distinction’) are just as simple, fundamental and astonishingly similar. Nevertheless, there are characteristic differences.  Fig. 1:

By |2025-11-15T12:33:39+00:0023. August 2024|Categories: Information, Logic, Bits|Tags: , , , |0 Comments

Five Preconceptions about Entropy

Which of these Preconceptions do you Share? Entropy is for nerds Entropy is incomprehensible Entropy is thermodynamics Entropy is noise Entropy is absolute Details 1. Entropy is the Basis of our Daily Lives Nerds like to be interested in complex topics and entropy fits in well, doesn't it? It helps them to portray themselves as superior intellectuals. This is not your game and you might not see any practical reasons to occupy yourself with entropy. This attitude is very common and quite wrong. Entropy is not a nerdy topic, but has a fundamental impact on our lives, from elementary physics

By |2025-11-25T18:15:57+00:0016. August 2024|Categories: Information, Entropy|Tags: , , |0 Comments
Go to Top