ELEMENTS OF INFORMATION THEORY Second Edition THOMAS M. COVERJOY A. THOMAS and solution 1 Introduction 2 Entropy, Relative Entropy and Mutual Information 3 The Asymptotic Equipartition Property 4 Entropy Rates of a Stochastic Process 5 Data Compression 6 Gambling and Data Compression 7 Channel Capacity 8 Di erential Entropy 9 Gaussian channel 10 Rate Distortion Theory 11 Information Theory and Statistics 12 Maximum ...