# Discuss ch 10 of "Elements of Information Theory" [series meeting]

• July 2, 2014 · 7:00 PM

Newcomers:

If you're new to the group, you're welcome to come to any meeting!  We're deep in some prerequisite-dependent material for now, but Ch 11 will be an excellent place to jump in!  That should be on July 30.

Overview:

We're reading a popular text in Information Theory which goes into some detail on data compression and communication channels. Definitely a good one to work through!
http://www.amazon.com/Elements-Information-Theory-Telecommunications-Processing/dp/0471062596

When you RSVP, please email your full name to [masked].   If we host at my work again, we'll need your name to put you on the list to get through security.  Don't forget to bring ID!

We'll review chapter 10.4 - the end of ch 10 (on rate distortion theory), and work through some problems.

Would anyone like to volunteer to present a problem?  Let us know in the comments!  I'll read through the problems, and suggest a few that look interesting.  Feel free to do the same!  We'll present solutions and discuss the material at the next meet up.

Recommended Prerequisites:

Probability theory: (moderate level) Joint distributions and marginalization; conditioning; Bayes' Theorem; Law of Large Numbers, Asymptotic Equipartition Property

• Analysis: (beginner to moderate level) Know what a set is; know what a logarithm is; understand the basic ideas of proofs

Calculus (moderate level) be able to take integrals, and understand the relationship between infinite sums and integrals.

• Chs. 1 - 9 -- we're getting fairly pre-requisite dependent now, until we get into the stats part later on (Ch. 11).

• ##### Kirill

It seems that information theory is the new tool to achieve good progress in classical problems. Besides the paper on primes that i mentioned before here is another one:
http://www.mathematik.uni-bielefeld.de/ahlswede/homepage/public/217.pdf
Now, Terence Tao is one of the better mathematicians of today, apparently he just got Breakthrough prize - the first time it is awarded to mathematicians.

1 · June 23

• ##### FNU T.

Are we skipping the week in between: July 2nd?

June 19

### New York, NY

Founded Nov 21, 2013

Contact

#### People in this Meetup are also in:

• ##### The New York Python Meetup Group

7,055 Python Programmers and Users

• ##### Code Crew - Let's Learn to Code Together!

7,571 Swabbies

• ##### NY Tech Meetup

43,986 NYC Technologists

• ##### NYC on Rails

4,215 Ruby developers

• ##### Data Rave

836 Data Ravers

1,414 Pythonistas

### Sometimes the best Meetup Group is the one you start

Rafaël

We just grab a coffee and speak French. Some people have been coming every week for months... it creates a kind of warmth to the group.

Rafaël, started French Conversation Group