Discuss ch 11 of "Elements of Information Theory" [series meeting]


If you're new to the group, you're welcome to come to any meeting!  This meeting (Ch. 11) should be a great one to jump into, compared with other chapters.  It's much less prerequisite dependent, and covers some foundational theorems in statistics!


We're reading a popular text in Information Theory which goes into some detail on data compression and communication channels. Definitely a good one to work through!

When you RSVP, please email your full name to [masked].   If we host at my work again, we'll need your name to put you on the list to get through security.  Don't forget to bring ID!

We'll review chapter the first through middle part of chapter 11, and work through some problems.  

Would anyone like to volunteer to present a problem?  Let us know in the comments!  I'll read through the problems, and suggest a few that look interesting.  Feel free to do the same!  We'll present solutions and discuss the material at the next meet up.

 Recommended Prerequisites:

Probability theory: (moderate level) Joint distributions and marginalization; conditioning; Bayes' Theorem; Law of Large Numbers, Asymptotic Equipartition Property

• Analysis: (beginner to moderate level) Know what a set is; know what a logarithm is; understand the basic ideas of proofs

Calculus (moderate level) be able to take integrals, and understand the relationship between infinite sums and integrals.

• Chs. 1 - 3, Ch. 8 -- Just know about entropy, differential entropy, and information, the AEP, and typicality.

Join or login to comment.

  • Adam K.

    Hey Wei! The remainder of Ch 11: Chernoff Stein Lemma until the end!

    August 13

  • Wei W.

    which sections are we going to discuss this evening?

    August 13

  • Adam K.

    Sorry everyone! Accidentally put the wrong date when I scheduled this one! I'd keep the wrong date if it wasn't Tushar ' s last meeting! We'll still be finishing up ch 11 at the time of the incorrectly scheduled meeting, fyi.

    July 29

People in this
Meetup are also in:

Sometimes the best Meetup Group is the one you start

Get started Learn more

I started the group because there wasn't any other type of group like this. I've met some great folks in the group who have become close friends and have also met some amazing business owners.

Bill, started New York City Gay Craft Beer Lovers

Sign up

Meetup members, Log in

By clicking "Sign up" or "Sign up using Facebook", you confirm that you accept our Terms of Service & Privacy Policy