Physics calls on information theory when it comes to account for entropy. I suspect that a proper coverage of Bayesian inference will be needed to make sense of quantum mechanics. However, these are not areas on which I have a fully-developed understanding: I shall probably come to them late in my more orderly writings.
Written by Eddy.