Skip to content

Multimodal Transformers - Custom LLMs, ViTs & BLIPs

Photo of Sam Witteveen
Hosted By
Sam W. and Martin A.
Multimodal Transformers - Custom LLMs, ViTs & BLIPs

Details

Continuing the theme of something new/interesting being released daily - this month we look at what models, systems and techniques have come out recently related to multimodal tasks.

Talks:

Images+LLMs : Advances in Multimodal Models - Martin Andrews

ViT, BLIP-2, MiniGPT-4, and InstructBLIP are four recent advances in artificial intelligence that have the potential to revolutionize the way we interact with computers. This talk will explore the development arc of these technologies, from their early beginnings to their current state-of-the-art capabilities.

Transformers Agents and Building your own Multi Modal system - Sam Witteveen

As all these new components and models become available the challenge becomes how to use together to put together some kind of app/bot. Sam will go through some approaches you can think about for making a multi-modal system.

Using LLMs to perform Job Grading and Evaluations - Yip Jia Qi

Job Grading is a task that is quite systematic, but hard to automate because of the sheer number of possibilities and many judgement calls that have to be made. This talk explores whether an LLM was up to the challenge. (Lightning Talk)

Talks will start at 7:00pm and end at around 8:30pm, at which point people normally come up to the front for a bit of a chat with each other, and the speakers.

***

As always, we're actively looking for more speakers - both '30 minutes long-form', and lightning talks. For the lightning talks, we welcome folks to come and talk about something cool they've done with TensorFlow, PyTorch, JAX and/or Deep Learning for 5-10mins (so, if you have slides, then #max=10). We believe that the key ingredient for the success of a Lightning Talk is simply the cool/interesting factor. It doesn't matter whether you're an expert or and enthusiastic beginner: Given the responses we have had, we're sure there are lots of people who would be interested to hear what you've been playing with. Please suggest yourself here :
https://www.meetup.com/Machine-Learning-Singapore/suggestion/

Photo of Machine Learning Singapore group
Machine Learning Singapore
See more events
Google Developers Space, Singapore
80 Pasir Panjang Rd · Singapore