Information Theory

Probability theory forms the basis of information theory, which quantifies the information present in a data set and plays an important element in Machine Learning.

Topics:

• Measure of Information
• Information Entropy