It looks like you're new here. If you want to get involved, click one of these buttons!

- All Categories 1.9K
- Applied Category Theory Course 42
- Applied Category Theory Exercises 62
- Azimuth Code Project 107
- News and Information 550
- Chat 406
- Azimuth Blog 148
- Azimuth Forum 29
- Azimuth Project 190
- - Strategy 109
- - Conventions and Policies 21
- - Questions 43
- Azimuth Wiki 706
- - Latest Changes 698
- - - Action 14
- - - Biodiversity 8
- - - Books 1
- - - Carbon 9
- - - Computational methods 38
- - - Climate 53
- - - Earth science 23
- - - Ecology 43
- - - Energy 29
- - - Experiments 30
- - - Geoengineering 0
- - - Mathematical methods 69
- - - Meta 9
- - - Methodology 16
- - - Natural resources 7
- - - Oceans 4
- - - Organizations 34
- - - People 6
- - - Publishing 4
- - - Reports 3
- - - Software 20
- - - Statistical methods 2
- - - Sustainability 4
- - - Things to do 2
- - - Visualisation 1
- General 37

Options

Hi all:

I am Pradeep. I work on Information theory and statistics. I want to understand and apply resource theories for information processing tasks that go beyond typical communication scenarios (in the sense of Shannon). I am also interested in the interaction between information theory and order theory. I am really looking forward to see how a categorical approach can throw some new light on this.

## Comments

Pradeep, you might be interested in the logical information theory that underlies the Shannon theory, the latter being a requantification of the logical theory for the purposes of coding and communications theory. See the paper linked in my Introduction.

`Pradeep, you might be interested in the logical information theory that underlies the Shannon theory, the latter being a requantification of the logical theory for the purposes of coding and communications theory. See the paper linked in my Introduction.`

Thanks David for the reference. I am interested in the measure-theoretic foundations of information theory. I will post my comments once I read it.

By the way, would you like to comment on this work that tries to define a notion of "shared information" based on set intersections: https://arxiv.org/abs/1004.2515?

`Thanks David for the reference. I am interested in the measure-theoretic foundations of information theory. I will post my comments once I read it. By the way, would you like to comment on this work that tries to define a notion of "shared information" based on set intersections: https://arxiv.org/abs/1004.2515?`

Welcome to the Azimuth Forum, Pradeep! I too am very interested in the intersection of category theory and information theory. While we're inflicting references on each other, I'll mention this one that chararacterizes Shannon information:

Entropy13(2011), 1945-1957.and this one that characterizes relative information:

Theory and Applications of Categories29(2014), 421-456.I've also been thinking about information theory in biology:

Entropy18(2016), 46.`Welcome to the Azimuth Forum, Pradeep! I too am very interested in the intersection of category theory and information theory. While we're inflicting references on each other, I'll mention this one that chararacterizes Shannon information: * John Baez, Tobias Fritz and Tom Leinster, <a href = "http://arxiv.org/abs/1106.1791">A characterization of entropy in terms of information loss</a>, <a href ="http://www.mdpi.com/1099-4300/13/11/1945/"><i>Entropy</i></a> <b>13</b> (2011), 1945-1957. and this one that characterizes relative information: * John Baez and Tobias Fritz, <a href = "http://arxiv.org/abs/1402.3067">A Bayesian characterization of relative entropy</a>, <i><a href = "http://www.tac.mta.ca/tac/volumes/29/16/29-16abs.html">Theory and Applications of Categories</a></i> <b>29</b> (2014), 421-456. I've also been thinking about information theory in biology: * John Baez and Blake S. Pollard, <a href = "http://arxiv.org/abs/1512.02742">Relative entropy in biological systems</a>, <i><a href = "http://www.mdpi.com/1099-4300/18/2/46">Entropy</a></i> <b>18</b> (2016), 46.`

Hi John,

Thanks for the references. I must admit I am now aware of these references for quite sometime now mostly because I try following Tobias Fritz's work whose office is in the adjacent section in our institute:-)

One of the principle objectives of joining this course is to better understand these works you mentioned. I work on channel preorders in information theory and want to see how categorical insights can help.

`Hi John, Thanks for the references. I must admit I am now aware of these references for quite sometime now mostly because I try following Tobias Fritz's work whose office is in the adjacent section in our institute:-) One of the principle objectives of joining this course is to better understand these works you mentioned. I work on channel preorders in information theory and want to see how categorical insights can help.`

Pradeep - say hi to Tobias! I talk to him quite often by email.

I believe categorical insights can help us better understand information theory, but it's very early days for this research so there are still a lot of simple fundamental insights left to be discovered - like the theorem that Tobias, Tom and I proved, in which the concept of entropy "pops out" of simple ideas combining probability and category theory. So, it's not as if there's a vast body of tools waiting to be applied; we're just starting to build the tools.

`Pradeep - say hi to Tobias! I talk to him quite often by email. I believe categorical insights can help us better understand information theory, but it's very early days for this research so there are still a lot of simple fundamental insights left to be discovered - like the theorem that Tobias, Tom and I proved, in which the concept of entropy "pops out" of simple ideas combining probability and category theory. So, it's not as if there's a vast body of tools waiting to be applied; we're just starting to build the tools.`

Hi John,

Indeed, it is exciting times working on this interface of category and information theory. Tobias said he is going to join the class soon.

`Hi John, Indeed, it is exciting times working on this interface of category and information theory. Tobias said he is going to join the class soon.`