addressalign-toparrow-leftarrow-rightbackbellblockcalendarcameraccwcheckchevron-downchevron-leftchevron-rightchevron-small-downchevron-small-leftchevron-small-rightchevron-small-upchevron-upcircle-with-checkcircle-with-crosscircle-with-pluscrossdots-three-verticaleditemptyheartexporteye-with-lineeyefacebookfolderfullheartglobegmailgooglegroupshelp-with-circleimageimagesinstagramlinklocation-pinm-swarmSearchmailmessagesminusmoremuplabelShape 3 + Rectangle 1ShapeoutlookpersonJoin Group on CardStartprice-ribbonShapeShapeShapeShapeImported LayersImported LayersImported Layersshieldstartickettrashtriangle-downtriangle-uptwitteruserwarningyahoo

Discuss ch 10 of "Elements of Information Theory" [series meeting]

Here's a popular text in Information Theory which goes into some detail on data compression and communication channels. Definitely a good one to read through!
http://www.amazon.com/Elements-Information-Theory-Telecommunications-Processing/dp/0471062596

When you RSVP, please email your full name to [masked].   If we host at my work again, we'll need your name to put you on the list to get through security.  Don't forget to bring ID!

After a brief presentation on a proof at the end of Ch. 9, we'll review chapter 10.1 - 10.3, and work through some problems.

Would anyone like to volunteer to present a problem?  Let us know in the comments!  I'll read through the problems, and suggest a few that look interesting.  Feel free to do the same!  We'll present solutions and discuss the material at the next meet up.

 Recommended Prerequisites:

Probability theory: (moderate level) Joint distributions and marginalization; conditioning; Bayes' Theorem; Law of Large Numbers, Asymptotic Equipartition Property

• Analysis: (beginner to moderate level) Know what a set is; know what a logarithm is; understand the basic ideas of proofs

Calculus (moderate level) be able to take integrals, and understand the relationship between infinite sums and integrals.

• Chs. 1 - 9 -- we're getting fairly pre-requisite dependent now, until we get into the stats part later on (Ch. 11).

Join or login to comment.

  • FNU T.

    Hi!

    Its a was great discussion yesterday, trying to solve the mystery of 1/2 :D

    During dinner, I mentioned about the Machine learning study group, that takes place every Saturday. Details for upcoming meet are available here- <https://piazza.com/nyc_ml_study_group/summer2014/cs4500/home>;. You are welcome to drop-by for any of the meetings. There are many awesome people in the group.
    I'll post agenda for the topics that we cover beforehand on piazza. Send me an email on <[masked]>, I'll add you to the Piazza forum.


    Have a great weekend.

    Cheers,
    Tushar

    1 · June 19, 2014

    • Adam K.

      See you tomorrow!

      June 20, 2014

6 went

People in this
Meetup are also in:

Sign up

Meetup members, Log in

By clicking "Sign up" or "Sign up using Facebook", you confirm that you accept our Terms of Service & Privacy Policy