Knowns and Unknowns: Testing AI Generated Code

## Knowns and Unknown: Testing AI-generated Code

• Let's face it AI-assisted coding is rapidly becoming the primary way applications are being written. The power of being able to write out a complicated application or feature with a just a few commands is something too alluring to pass up.
• But between the imprecise nature of language and LLMs ability to "hallucinate", this creates many opportunities for bugs and unintended behavior to introduced. Just telling an AI coding agent to "write tests" isn't going to be enough to build confidence in the correctness of an application either.
• In this presentation we are going to review three distinct phases to testing AI written code. The known knowns; using spec driven development to define the business meaningful behavior of your application. Known unknowns; using property-based testing to handle edge cases and avoid over fitting and unintended biases. And finally unknown unknowns, using static analysis and mutation testing to avoid introducing bugs you didn't think about.
• AI-assisted coding is a rapidly evolving field, but this presentation should give you the framework and approach on how to have confidence when using AI to assist in writing applications.

## Format

• 6:30pm — Welcome & Networking: Pizza, drinks and name tags will be provided—come hungry and ready to connect!
• 7:00pm — Get people into the auditorium.
• 7:05pm — Orlando JUG and ODevs opening remarks.
• 7:10pm — Featured presentation by guest speaker.
• 8:20pm — Q&A + Social Time. Two attendees will each win a JetBrains license (e.g. IntelliJ IDEA, CLion, PyCharm Pro, ReSharper, etc.) and 3 attendees will each win an O'Reilly book.

## Speaker

• Billy Korando is a Java Developer Advocate with the Java Platform Group at Oracle. With over a decade of experience in Java, Billy brings a passion for helping developers reduce tedious work, such as project initiation, deployment, testing, and validation, through automation and adopting the latest features and tools in the Java ecosystem. Outside of work, Billy enjoys traveling, playing kickball, and cheering on the Kansas City Chiefs. Billy also co-organizes the Kansas City Java users group.

## Links

• Orlando JUG: https://www.meetup.com/orlandojug/
• Billy Korando @ LinkedIn: https://www.linkedin.com/in/billy-korando-129b8197/
• Percy Vega @ LinkedIn: https://www.linkedin.com/in/percyvega/
• Trung (Daniel) An @ LinkedIn: https://www.linkedin.com/in/trung-daniel-an/

## Parking

• There is free street parking after 6pm.
• Also, UCF has a day permit that is $8 for the whole day and you can park in the UCF Parramore Parking Garage.
• Metered Parking (via ParkMobile, DTO code): are metered spots available on streets near venue.

## Sponsors

• Orlando Devs: ODevs is a vibrant community of software developers, designers, and tech enthusiasts in the Orlando and Central Florida area, dedicated to fostering growth, collaboration, and knowledge sharing among its members.
• JetBrains: JetBrains develops a suite of developer tools, including Integrated Development Environments (IDEs), team tools, and other software designed to enhance programmer productivity and code quality.
• O'Reilly: O'Reilly Media is a premier publisher established in 1978, renowned for its technical books featuring distinctive animal woodcut covers. It provides comprehensive technical and business education through an online learning platform, offering books, videos, live training, and interactive tutorials.