What is information entropy?  It is borrowed from the discipline of physics which is a measure of the disorder among the gas molecules. In Machine learning, this concept has been used by Dr. Shannon in his paper “A Mathematical Theory of Communication” published in 1948. It is called information entropy. In simple terms, it can be understood as … More Information Entropy for Social Science research