AI Meetup (June): GenAI, LLMs and Agent


Details
Important: Register on the AICamp event website is required for admission.
Welcome to AI and ML meetup in Sydney. Join us for deep dive tech talks on AI, GenAI, LLMs and Agents, hands-on experiences on code labs, workshops, and networking with speakers and fellow developers.
Tech Talk: AI model for Cybersecurity
Speaker: Arun Prasad (AIWhispr)
Abstract: Training the worlds AI model to conduct ISO 270001 cybersecurity policy assessments and cloud security scans. In this talk, Arun will explain how they trained open weights AI models for StickmanCyber, an Australian cybersecurity services provider, to reach human level accuracy as an internal auditor and cloud engineer for cybersecurity frameworks assessment. This is now used to provide first level cybersecurity assessments for multiple enterprises in Australia. The techniques involved using a chain of models, finetuning, RLHF , chain of thought.
Tech Talk: Rapid Attention Distillation to Linear Attention Decoder at Scale
Speaker: Harrison Vanderbyl (Featherless AI)
Abstract: Architecture innovation with language models is normally thought to be an incredibly expensive, time consuming process. To train a 70B model from scratch can require many millions of dollars, and many months, to accomplish. Our team at Featherless.ai, working with the RWKV foundation and open source community, have released a method to convert existing models to new architectures with only a tiny fraction of the time and money normally required. This opens up the gates to model architecture innovation that allows us to completely sidestep the costs of proving and scaling new architectures.
Sponsors:
- Microsoft Reactor: Microsoft Reactors are centers for free technical learning and sharing, where developers and startup professionals can connect with the local community and build new skills to drive innovation. Learn More
We are actively seeking sponsors to support our community. Whether it is by offering venue spaces, providing food/drink, or cash sponsorship. Sponsors will not only speak at the meetups, receive prominent recognition, but also gain exposure to our extensive membership base of 5,000+ AI developers in Sydney and 500K+ worldwide.


AI Meetup (June): GenAI, LLMs and Agent