The physics of information: From flipping coins to quantum gravity