add-memberalign-toparrow-leftarrow-rightbellblockcalendarcamerachatchevron-leftchevron-rightchevron-small-downchevron-upcircle-with-crosscomposecrossfacebookflagfolderglobegoogleimagesinstagramkeylocation-pinmedalmoremuplabelShape 3 + Rectangle 1pagepersonpluspollsImported LayersImported LayersImported LayersshieldstartwitterwinbackClosewinbackCompletewinbackDiscountyahoo

Discuss ch 11 of "Elements of Information Theory" [series meeting]


If you're new to the group, you're welcome to come to any meeting!  This meeting (Ch. 11) should be a great one to jump into, compared with other chapters.  It's much less prerequisite dependent, and covers some foundational theorems in statistics!


We're reading a popular text in Information Theory which goes into some detail on data compression and communication channels. Definitely a good one to work through!

When you RSVP, please email your full name to [masked].   If we host at my work again, we'll need your name to put you on the list to get through security.  Don't forget to bring ID!

We'll review chapter the first through middle part of chapter 11, and work through some problems.  

Would anyone like to volunteer to present a problem?  Let us know in the comments!  I'll read through the problems, and suggest a few that look interesting.  Feel free to do the same!  We'll present solutions and discuss the material at the next meet up.

 Recommended Prerequisites:

Probability theory: (moderate level) Joint distributions and marginalization; conditioning; Bayes' Theorem; Law of Large Numbers, Asymptotic Equipartition Property

• Analysis: (beginner to moderate level) Know what a set is; know what a logarithm is; understand the basic ideas of proofs

Calculus (moderate level) be able to take integrals, and understand the relationship between infinite sums and integrals.

• Chs. 1 - 3, Ch. 8 -- Just know about entropy, differential entropy, and information, the AEP, and typicality.

Join or login to comment.

  • Wei W.

    cannot make it this week.. have fun!

    July 30, 2014

3 went

People in this
Meetup are also in:

Sign up

Meetup members, Log in

By clicking "Sign up" or "Sign up using Facebook", you confirm that you accept our Terms of Service & Privacy Policy