Information Theory establishes theoretical limits on the performance of techniques for compression or error correction of signals. A core of common ideas links the fields of Information Theory, Ergodic Theory, Statistics, and Statistical Mechanics, and the text dedicates several chapters to these links. While I will touch on these links in the course, I will concentrate on communications applications, specifically source coding and channel coding for discrete signals. I will certainly cover the material in chapters 1 through 5, and chapter 8 of the text. In the remaining time I may examine part of the generalization to continuous signals (chapters 9, 10, 12, and 13).
Course Announcement at http://www.ece.pdx.edu/~andy/info1/announce.pdf.
Syllabus at http://www.ece.pdx.edu/~andy/info1/syllabus.pdf.
HW assignments at http://www.ece.pdx.edu/~andy/info1/hw.pdf (I may change the assignments from previous years).
Small notes on Cesaro mean, Lagrange multipliers, and fractal densities at http://www.ece.pdx.edu/~andy/info1/notes.pdf.
Preparation sheet for Midterm at http://www.ece.pdx.edu/~andy/info1/mtprep.pdf.
Fraser's notes on chapter 8 (Channel Capacity) at http://www.ece.pdx.edu/~andy/info1/chan_notes.pdf.
Final preparation notes at http://www.ece.pdx.edu/~andy/info1/finalprep.pdf.
Final solutions at http://www.ece.pdx.edu/~andy/info1/final_sol.pdf.
Notes on image compression software framework http://www.ece.pdx.edu/~andy/info1/KB1.pdf.
Tarfile of Fraser's image compression software framework that does not include test images http://www.ece.pdx.edu/~andy/info1/KB0_wo_miff.tar.
Tarfile of Fraser's image compression software framework that includes a test image http://www.ece.pdx.edu/~andy/info1/KB0_w_miff.tar.
Directory of Fraser's image compression software framework that includes a test image http://www.ece.pdx.edu/~andy/info1/KB0.
Ralf has cleaned up my code. His version passes binary data through the pipes and does not require the python Numeric package. On my machine, it creates recovered.miff in 34.5 seconds while my version requires 226.2 seconds. His code is at http://www.ece.pdx.edu/~andy/info1/KB0r.tar.
Felipe has written code that runs under Windows. I have not tested it. His code is at http://www.ece.pdx.edu/~andy/info1/KB0fo.zip.
There are a few of my vacation pictures in miff format in the directory http://www.ece.pdx.edu/~andy/info1/miffs that you may use for testing.