# Discuss ch 5.1 - 5.5 of "Elements of Information Theory" [series meeting]

• February 19, 2014 · 7:00 PM

Here's a popular text in Information Theory which goes into some detail on data compression and communication channels. Definitely a good one to read through!
http://www.amazon.com/Elements-Information-Theory-Telecommunications-Processing/dp/0471062596

When you RSVP, please email your full name to [masked].   If we host at my work again, we'll need your name to put you on the list to get through security.  Don't forget to bring ID!

This is the fifth meet up in this series!  We'll cover the first half of Chapter 5 (stopping just before Huffman Codes), and work through some problems.

Would anyone like to volunteer to present a problem?  Let us know in the comments!  I'll read through the problems, and suggest a few that look interesting.  Feel free to do the same!  We'll present solutions and discuss the material at the next meet up.

Now we're getting to the heart of the compression aspects of information theory.

Recommended Prerequisites:

Probability theory: (moderate level) Joint distributions and marginalization; conditioning; Bayes' Theorem

• Analysis: (beginner to moderate level) Know what a set is; know what a logarithm is; understand the basic ideas of proofs by induction, contradiction, etc.

Chapter 4: Understand the material from chapter 4 and earlier.

• ##### Jean G.

Concerning the lockbox riddle, could you write it down? I think I may be missing a part.

1 · February 19, 2014

)

February 24, 2014

• ##### Jean G.

Okay, so questions:
If a box is empty but unlocked, will it be stopped at the border?
Are these 'slam boxes', ie you need a key to open them but not to close them?

February 26, 2014

• ##### Shannon

Hey guys, sorry I couldn't make it last week! Is there a meetup tonight? I didn't see one on the group page, but I may just be looking in the wrong place! Thanks!

February 26, 2014

• ##### Shannon

P.S. If the meetup is on for tonight, I assume the goal was to finish up chapter 5?

February 26, 2014

Hey Shannon! We'll be finishing up chapter 5. We meet every 2 weeks, so the next one is actually a week from today.

February 26, 2014

• ##### Kirill

My apologies for dragging everyone for wine as opposed to beer.

1 · February 20, 2014

• ##### Linda C.

We're not going to wine about that!

1 · February 21, 2014

• ##### Todd H. S.

the best

1 · February 20, 2014

• ##### Kirill

I worked on a problem - unused code sequences (#20 in my book). If i make it i present what i have.

February 19, 2014

• ##### Kate T.

I wish I can join the meeting, but I have a class on every Wednesday until the end of April.

February 18, 2014

• ##### Todd H. S.

I love compression

1 · February 17, 2014

Hey Everyone! Shannon sent this cool assignment from her CS class: https://courses.cs.washington.edu/courses/cse143/09sp/handouts/28.html
This might be a fun thing to work out/discuss when we get to Huffman coding, in the second part of Ch. 5.

1 · February 7, 2014

### 18 went

• ##### andy h.
• A former member

### New York, NY

Founded Nov 21, 2013

Contact

#### People in this Meetup are also in:

• ##### SQL NYC, The NoSQL & NewSQL Database Meetup

8,916 Data Enthusiasts

• ##### NYC Data Wranglers

1,146 Data Scientists

• ##### NYC Data Science

4,034 Data Scientists

• ##### UX + Data

1,418 Members

• ##### Hack Manhattan

1,971 hackers

2,612 Coders

### Create a Meetup Group and meet new people

Henry

I decided to start Reno Motorcycle Riders Group because I wanted to be part of a group of people who enjoyed my passion... I was excited and nervous. Our group has grown by leaps and bounds. I never thought it would be this big.

Henry, started Reno Motorcycle Riders