NeurIPS and the State of Deep Learning

The focus for this MeetUp's talks will be the interesting developments that were seen at the NeurIPS conference held last December and other recent research announcements.

---

Planned Talks :

"State of Generative Modeling " - Sam Witteveen

Sam's talk will cover some of the presentations and papers covering the current state of Generative Modeling, including new GAN techniques, Diffusion approaches, MultiModal models and other interesting forms of generative modeling.

POSTPONED “”Is the future of Transformers Sparse?” - Martin Andrews

Martin’s talk will connect together several less well known Transformer papers at the conference, and show how they shine a light on how Transformers can be trained to remember more efficiently and where Transformers could be going in the future.

BREAKING NEWS "RETRO vs LaMDA : Clash of the Transformers"

Google released a paper about the LaMDA dialog model last night, and (rather than have 2 long talks) Martin will give a run-down of how this new model was built - and some of the tricks used to start beating humans on dialog! DeepMind's RETRO model will also be explained, since it uses a different, innovative method to add 'knowledge' to its answers.

(Martin's Sparsity+ talk will be given at next month's MeetUp)

---

Talks will start at 8pm (A/V equipment permitting) and end at around 9:30pm. If you have any suggestions about how to make the sessions / post-talk gathering more 'social' please let us know!

---

As always, we're actively looking for more speakers for future events - both '30 minutes long-form', and lightning talks. For the lightning talks, we welcome folks to come and talk about something cool they've done with TensorFlow and/or Deep Learning for 5-10mins (so, if you have slides, then #max=10). We believe that the key ingredient for the success of a Lightning Talk is simply the cool/interesting factor. It doesn't matter whether you're an expert or and enthusiastic beginner: Given the responses we have had, we're sure there are lots of people who would be interested to hear what you've been playing with.

Please suggest yourself here :
https://www.meetup.com/Machine-Learning-Singapore/suggestion/