Entropy: Combinations and Permutations
In my ongoing quest to lay a more solid foundation for this new, strange life as a machine learning “researcher”, I’ve been going through various foundational concepts and ideas and trying to build up rock solid intuitions that I can lean on for years. (Why the hell didn’t I do this back in school??) Entropy is my latest obsession - thermodynamic entropy, and information entropy, and the ways in which these two things are similar. ...