When BERT plays the lottery, all tickets are winning!


Details
Hello Members,
Look what WiMLDS-Hyderabad has got for you on the eve of International Women's Day 2021!!!
Anna Rogers is a post-doctoral associate at the University of Copenhagen. Her main research areas are interpretability, evaluation and analysis of deep learning models for NLP. She is also active in the sphere of meta-research and NLP methodology, working on issues in peer review and organizing the workshop on Insights from Negative Results in NLP (EMNLP 2020, 2021).
Abstract: The lottery ticket hypothesis was originally developed for randomly initialized models, but might it also apply to pre-trained Transformers? If the “good” subnetworks exist, can they tell us anything about how BERT achieves its performance?
Looking forward for your energetic participation.
Topic : When BERT plays the lottery, all tickets are winning!
📅 : 07th March,2021
⏱️ : 3.30 PM IST (11.00 AM CET)
💻 : Online
🔗. : https://meet.jit.si/BERTology-with-WiMLDSHyd

When BERT plays the lottery, all tickets are winning!