Entropy

Entropy between Micro- and Macro Level

Entropy between Micro- and Macro Level

Two Levels define Entropy: Micro and Macro Two levels Define Entropy The conventional physical definition of entropy characterises it as a difference between two levels: a detail level and an overview level. Example Coffee Cup The thermal entropy according to Boltzmann is classic, using the example of an ideal gas. The temperature (1 value) is directly linked to the kinetic energies of the individual gas molecules (1023 values). With certain adjustments, this applies to any material object, e.g. also to a coffee cup: Thermal macro state: temperature of the liquid in the cup. Thermal micro state: kinetic energy of all

By Hans Rudolf Straub|2025-12-03T14:48:40+00:0027. September 2024|Categories: Information, Entropy, Micro / Macro|Tags: entropy, Information paradox, Ludwig BoltzImann, Macro Level, Micro Level|0 Comments

What is Entropy?

Definition of Entropy The term entropy is often avoided because it contains a certain complexity. The phenomenon entropy, however, is constitutive for everything that is going on in our lives. A closer look is worth the effort. Entropy is a measure of information and it is defined as: Entropy is the information - known at micro, - but unknown at macro level. The challenge of this definition is: to understand what is meant by the micro and macro states and to understand why entropy is a difference. What is Meant by Micro and Macro Level? The micro level contains the

By Hans Rudolf Straub|2025-11-15T12:31:44+00:004. September 2024|Categories: Entropy|Tags: entropy, Laws of Form, Macro Level, Micro Level, Niklas Luhmann, Observer, Re-Entry|0 Comments

Five Preconceptions about Entropy

Which of these Preconceptions do you Share? Entropy is for nerds Entropy is incomprehensible Entropy is thermodynamics Entropy is noise Entropy is absolute Details 1. Entropy is the Basis of our Daily Lives Nerds like to be interested in complex topics and entropy fits in well, doesn't it? It helps them to portray themselves as superior intellectuals. This is not your game and you might not see any practical reasons to occupy yourself with entropy. This attitude is very common and quite wrong. Entropy is not a nerdy topic, but has a fundamental impact on our lives, from elementary physics

By Hans Rudolf Straub|2025-11-25T18:15:57+00:0016. August 2024|Categories: Information, Entropy|Tags: Bit, Chaos, entropy|0 Comments

Information Reduction 7: Micro and Macro State

Examples of information reduction In previous texts we looked at examples of information reduction in the following areas: Coding / classification Sensory perception DRG (Flat rate per case) Opinion formation Thermodynamics What do they have in common? Micro and macro state What all these examples have in common is that, in terms of information, there are two states: a micro state with a great many details and a macro state with much less information. One very clear example that many of us will remember from our school days is the relationship between the two levels in thermodynamics. The two states

By Hans Rudolf Straub|2025-11-15T13:22:25+00:0013. January 2020|Categories: Information, Entropy, Information Reduction, Micro / Macro|Tags: Information Reduction, Macro State, Micro State|0 Comments

Information Reduction 5: The Classic Glass of Water

Information reduction in thermodynamics A very specific example of information reduction can be found in the field of thermodynamics. What makes this example so special is its simplicity. It clearly illustrates the basic structure of information reduction without the complexity found in other examples, such as those from biology. And it’s a subject many of us will already be familiar with from our physics lessons at school. What is temperature? A glass of water contains a huge amount of water molecules, all moving at different speeds and in different directions. These continuously collide with other water molecules, and their speed

By Hans Rudolf Straub|2025-11-15T13:24:59+00:0011. June 2019|Categories: Information, Entropy, Information Reduction, Micro / Macro|Tags: Information Reduction, Information Theory, Ludwig Boltzmann, Macro Level, Micro Level, Thermodynamics|0 Comments

Information Reduction 2: The Funnel

The funnel of information reduction In my previous article Information reduction 1, I described a chain of information processing from the patient to the flat rate per case (DRG): This acts as a funnel, reducing the amount of information available at each step. The extent of the reduction is dramatic. Imagine we have the patient in front of us. One aspect of a comprehensive description of this patient is their red blood cells. There are 24-30 trillion (= 24–30·1012 ) red blood cells in the human body, each with a particular shape and location in the body, and each moving in