Winning entry for the 2017 CCIMI video contest. Video:
Many thanks to falcxne for allowing use of his songs “Said You Wouldn’t Change” (from the album Timbits III), “I Hate Homework (Interlude)” (from Timbits II) and “NYC (Interlude)” (from Timbits III); you can find these and more at https://falcxne.bandcamp.com/. And thanks to Phillipe Faist for creating the entropy zoo and allowing me to use it in the video. For more details on the continuity bounds mentioned, you can find a preprint here, which is joint work with my supervisor, Dr. Nilanjana Datta.
Lastly, one clarification: in the video, I talk about the data-compression example in the language of classical information theory, for simplicity. However, the quantum case can be described in a very similar way, with the von Neumann entropy replacing the Shannon entropy.