Information Theoretic Principles for Agent Learning

This book provides readers with the fundamentals of information theoretic techniques for statistical data science analyses and for characterizing the behavior and performance of a learning agent outside of the standard results on communications and compression fundamental limits. Readers will benefit from the presentation of information theoretic quantities, definitions, and results that provide or could provide insights into data science and learning. In addition, this book: - Describes the fundamentals of information theoretic techniques for statistical data science analyses - Provides succinct introductions to key topics, with references as needed for further technical depth - Enables readers from varying backgrounds to understand the behavior and performance of a learning agent