Discuss ch 11 of "Elements of Information Theory" [series meeting]

Newcomers:

If you're new to the group, you're welcome to come to any meeting!  This meeting (Ch. 11) should be a great one to jump into, compared with other chapters.  It's much less prerequisite dependent, and covers some foundational theorems in statistics!

Overview:

We're reading a popular text in Information Theory which goes into some detail on data compression and communication channels. Definitely a good one to work through!
http://www.amazon.com/Elements-Information-Theory-Telecommunications-Processing/dp/0471062596

When you RSVP, please email your full name to [masked].   If we host at my work again, we'll need your name to put you on the list to get through security.  Don't forget to bring ID!

We'll review chapter the first through middle part of chapter 11, and work through some problems.  

Would anyone like to volunteer to present a problem?  Let us know in the comments!  I'll read through the problems, and suggest a few that look interesting.  Feel free to do the same!  We'll present solutions and discuss the material at the next meet up.

 Recommended Prerequisites:

Probability theory: (moderate level) Joint distributions and marginalization; conditioning; Bayes' Theorem; Law of Large Numbers, Asymptotic Equipartition Property

• Analysis: (beginner to moderate level) Know what a set is; know what a logarithm is; understand the basic ideas of proofs

Calculus (moderate level) be able to take integrals, and understand the relationship between infinite sums and integrals.

• Chs. 1 - 3, Ch. 8 -- Just know about entropy, differential entropy, and information, the AEP, and typicality.

Join or login to comment.

  • Wei W.

    cannot make it this week.. have fun!

    July 30

3 went

People in this
Meetup are also in:

Create a Meetup Group and meet new people

Get started Learn more
Henry

I decided to start Reno Motorcycle Riders Group because I wanted to be part of a group of people who enjoyed my passion... I was excited and nervous. Our group has grown by leaps and bounds. I never thought it would be this big.

Henry, started Reno Motorcycle Riders

Sign up

Meetup members, Log in

By clicking "Sign up" or "Sign up using Facebook", you confirm that you accept our Terms of Service & Privacy Policy