It looks like you're new here. If you want to get involved, click one of these buttons!

- All Categories 2.2K
- Applied Category Theory Course 352
- Applied Category Theory Seminar 4
- Exercises 149
- Discussion Groups 49
- How to Use MathJax 15
- Chat 479
- Azimuth Code Project 108
- News and Information 145
- Azimuth Blog 148
- Azimuth Forum 29
- Azimuth Project 189
- - Strategy 108
- - Conventions and Policies 21
- - Questions 43
- Azimuth Wiki 710
- - Latest Changes 701
- - - Action 14
- - - Biodiversity 8
- - - Books 2
- - - Carbon 9
- - - Computational methods 38
- - - Climate 53
- - - Earth science 23
- - - Ecology 43
- - - Energy 29
- - - Experiments 30
- - - Geoengineering 0
- - - Mathematical methods 69
- - - Meta 9
- - - Methodology 16
- - - Natural resources 7
- - - Oceans 4
- - - Organizations 34
- - - People 6
- - - Publishing 4
- - - Reports 3
- - - Software 21
- - - Statistical methods 2
- - - Sustainability 4
- - - Things to do 2
- - - Visualisation 1
- General 39

Options

Here's a draft of a review article for the proceedings of the workshop I helped run at NIMBioS

- John Baez, Relative entropy in biological systems.

Abstract.In this paper we review various information-theoretic characterizations of the approach to equilibrium in biological systems. The replicator equation, evolutionary game theory, Markov processes and chemical reaction networks all describe the dynamics of a population or probability distribution. Under suitable assumptions, the distribution will approach an equilibrium with the passage of time. Relative information - that is, the Kullback-Leibler divergence, or various generalizations thereof - provides a quantitative measure of how far from equilibirum the system is. We explain various theorems that give conditions under which relative information is nonincreasing. In biochemical applications these results can be seen as versions of the Second Law of Thermodynamics, stating that free energy can never increase with the passage of time. In ecological applications, they make precise the notion that a population gains information form its environment as it approaches equilibrium.

Perhaps the title should say 'relative information' since I believe that term makes more sense than the usual 'relative entropy' (as I explain in the paper). Unfortunately more people use the term 'relative entropy'. So, right now the title is a bit at odds with the rest of the paper, which annoys me. But I'm fairly happy with most of the paper. It needs just a bit more work. I'll blog about it in a while.

## Comments

I blogged about it here, and am getting a few helpful comments.

`I blogged about it [here](https://johncarlosbaez.wordpress.com/2015/11/27/relative-entropy-in-biological-systems/), and am getting a few helpful comments.`