MLT __init__ Session #6: Attention is all you need

📌 Session #6: Attention is all you need
📌 Paper Reading & Discussion
📌 Vaswani at al. (2017): Attention is all you need https://arxiv.org/abs/1706.03762

About:
MLT init is a monthly event led by Jayson Cunanan and J. Miguel Valverde where a paper is first presented by a volunteer and then discussed among all attendees. Our goal is to give participants good initializations to study Deep Learning effectively. We also hope to promote collaboration between participants. We will try to achieve this by:

• Discussing fundamental papers whose key ideas apply to state-of-the-art models.

• Providing the audience with summaries, codes, and visualizations to help understand the critical parts of a research paper.

📌 Presenter: Charles Melby-Thompson, AI Researcher/ Physicist

📌 Prerequisites
We allocate most of the time for discussion and kindly ask participants to read the paper in advance and join the session with at least two questions or comments in mind. These can be parts of the research paper that you think is interesting or unclear. For instance: What did you like the most about this paper? What did you learn? What did you not understand?

––– Session structure –––
● 5:00-5:05 pm Introduction
● 5:05-5:30 pm Presentation
● 5:30-6:30 pm Discussion

📌 Join Zoom Meeting
https://us02web.zoom.us/j/86362568062?pwd=SS9hc251QzRwQkREaElZQVpza2dHQT09

📌 SPEAKER BIO
Charles Melby-Thompson is an AI Researcher at AI Inside working on object detection, OCR, and quantum computing. He obtained a Ph.D. in Physics from UC Berkeley, MSc Mathematics and Comp. Science from the University of Oxford and A.B. Physics from Princeton University. He has multiple research experiences from several countries including Japan. His hobbies include learning languages, playing the Cello, and cooking. https://www.linkedin.com/in/charles-melby-thompson/

📌ORGANIZERS' BIO

• J. Miguel Valverde is a Ph.D. student at the University of Eastern Finland working on Rodent MRI Segmentation with Deep Learning. He has multiple research experiences across Europe and Japan. In his free time, he enjoys nature, learning languages, programming, and making food. https://twitter.com/jmlipman

• Jayson Cunanan is an AI Researcher/Engineer at AI inside. He obtained a Ph.D. in Mathematics at Nagoya University and was awarded the JSPS Postdoctoral Fellowship 2018. In his free time, he loves playing the guitar. https://www.linkedin.com/in/jayson-cunanan-phd/
  https://twitter.com/jsonmathsAi

● Find more information, the videos, and materials from previous sessions in https://github.com/Machine-Learning-Tokyo/init

● MLT PATRON
Become a MLT Patron and help us to keep MLT meetups like this inclusive and for free. https://www.patreon.com/MLTOKYO

● SUBSCRIBE
Subscribe to our monthly newsletter: https://mltokyo.ai/membership-join

● FIND MLT RESOURCES
Github: https://github.com/Machine-Learning-Tokyo
Youtube: https://www.youtube.com/MLTOKYO
Slack: https://bit.ly/3ai1kte

● RECRUITING
MLT events are for community building and knowledge sharing. We politely ask that company representatives, recruiters, and consultants looking to hire or sell their services do not participate in MLT activities or approach members in any form.

● CODE OF CONDUCT
MLT promotes an inclusive environment that values integrity, openness, and respect. https://github.com/Machine-Learning-Tokyo/MLT_starterkit