Discuss ch 10 of "Elements of Information Theory" [series meeting]

Newcomers:

If you're new to the group, you're welcome to come to any meeting! We're deep in some prerequisite-dependent material for now, but Ch 11 will be an excellent place to jump in! That should be on July 30.

Overview:

We're reading a popular text in Information Theory which goes into some detail on data compression and communication channels. Definitely a good one to work through!
http://www.amazon.com/Elements-Information-Theory-Telecommunications-Processing/dp/0471062596

When you RSVP, please email your full name to akelleh@gmail.com. If we host at my work again, we'll need your name to put you on the list to get through security. Don't forget to bring ID!

We'll review chapter 10.4 - the end of ch 10 (on rate distortion theory), and work through some problems.

Would anyone like to volunteer to present a problem? Let us know in the comments! I'll read through the problems, and suggest a few that look interesting. Feel free to do the same! We'll present solutions and discuss the material at the next meet up.

Recommended Prerequisites:

• Probability theory: (moderate level) Joint distributions and marginalization; conditioning; Bayes' Theorem; Law of Large Numbers, Asymptotic Equipartition Property

• Analysis: (beginner to moderate level) Know what a set is; know what a logarithm is; understand the basic ideas of proofs

• Calculus (moderate level) be able to take integrals, and understand the relationship between infinite sums and integrals.

• Chs. 1 - 9 -- we're getting fairly pre-requisite dependent now, until we get into the stats part later on (Ch. 11).