Discuss ch 10 of "Elements of Information Theory" [series meeting]


If you're new to the group, you're welcome to come to any meeting!  We're deep in some prerequisite-dependent material for now, but Ch 11 will be an excellent place to jump in!  That should be on July 30.


We're reading a popular text in Information Theory which goes into some detail on data compression and communication channels. Definitely a good one to work through!

When you RSVP, please email your full name to [masked].   If we host at my work again, we'll need your name to put you on the list to get through security.  Don't forget to bring ID!

We'll review chapter 10.4 - the end of ch 10 (on rate distortion theory), and work through some problems.  

Would anyone like to volunteer to present a problem?  Let us know in the comments!  I'll read through the problems, and suggest a few that look interesting.  Feel free to do the same!  We'll present solutions and discuss the material at the next meet up.

 Recommended Prerequisites:

Probability theory: (moderate level) Joint distributions and marginalization; conditioning; Bayes' Theorem; Law of Large Numbers, Asymptotic Equipartition Property

• Analysis: (beginner to moderate level) Know what a set is; know what a logarithm is; understand the basic ideas of proofs

Calculus (moderate level) be able to take integrals, and understand the relationship between infinite sums and integrals.

• Chs. 1 - 9 -- we're getting fairly pre-requisite dependent now, until we get into the stats part later on (Ch. 11).

Join or login to comment.

  • Kirill

    It seems that information theory is the new tool to achieve good progress in classical problems. Besides the paper on primes that i mentioned before here is another one:
    Now, Terence Tao is one of the better mathematicians of today, apparently he just got Breakthrough prize - the first time it is awarded to mathematicians.

    1 · June 23

  • FNU T.

    Are we skipping the week in between: July 2nd?

    June 19

People in this
Meetup are also in:

Sometimes the best Meetup Group is the one you start

Get started Learn more

We just grab a coffee and speak French. Some people have been coming every week for months... it creates a kind of warmth to the group.

Rafaël, started French Conversation Group

Sign up

Meetup members, Log in

By clicking "Sign up" or "Sign up using Facebook", you confirm that you accept our Terms of Service & Privacy Policy