MAT330/681 LECTURE 25 (5/5/2021): CODING AND SHANNON ENTROPY





Announcements: Please remember that the last homework assignment, HW12, is due tonight via Blackboard; solutions will be posted shortly. Once again, PLEASE SUBMIT YOUR ANSWERS to the SETL form, it is completely anonymous and of great importance for me and for the college. I will personally read all your comments, and use them to determine what is working well, and what should be done differently. Make your voices heard, for this and all your other courses! Thank you!


• Video 1: How to quantify "surprise": Download file or watch below


• Video 2: Definition of Shannon entropy: Download file or watch below


• Video 3: Encoding information efficiently and unambiguously: Download file or watch below


• Video 4: Working towards some answers: Download file or watch below


• Video 5: Shannon's noiseless Coding Theorem: Download file or watch below





• Lecture Notes (static file from above videos): PDF file





Last updated: May 5, 2021, 1:00pm EDT