Name: The state of AI in large-scale automated refactoring - Jonathan Schneider
Start: 2025-02-27T18:30:00-05:00
End: 2025-02-27T20:30:00-05:00
Location: Free Times Cafe

**The state of AI in large-scale automated refactoring**

LLMs are data hungry, and when it comes to source code the text simply isn't enough to make large scale inferences about a codebase. As we know, code has a unique structure and strict grammar, as well as dependencies and type information that must be deterministically resolved by a compiler. This is information that could be incredibly useful for AI but is invisible to the text of the source code.

For example, if you're going to try to answer even a simple question about where Guava is used or where a particular logging library is used, you’ll find that while uses can occur in the code, the code-as-text may not have reference to the library you are looking for. Imagine a logger instance inherited as a protected field from a base class that is defined in a binary dependency. The import statement that identifies which logging library that logger is coming from is IN the binary dependency, not in the text of the call site. A human would do no better in this situation.

This keynote addresses how to improve AI accuracy for large-scale code refactoring by improving the data source. We’ll explore a state-of-the-art code data model called the Lossless Semantic Tree (LST) that’s part of the open source OpenRewrite auto-refactoring project. We’re finding that the LST and recipes are amazingly easy tools to equip LLMs with the data they need to make accurate decisions.

The common excuse for inaccuracy or incompleteness in output is that LLMs will get better, but actually I think the models are quite good enough right now. What they too often lack is the data to make inferences. We’ll show why, when evaluating LLMs for large scale automated refactoring:

* If it's based on text, you don't want it
* If it's based on AST, you don't want it

**About the venue**

Free Times Cafe has bistro-style seating and a full food and drink menu. Please consider helping to support the venue by planning to have supper during the talk.

**Speaker Bio:**

Jonathan Schneider is co-founder and CEO at Moderne, the pioneer of mass-scale auto-refactoring and analysis of codebases. He founded OpenRewrite, an auto-refactoring tool, at Netflix and went on to found the Micrometer project as a member of the Spring Team. He also is the author of “SRE with Java Microservices” (O’Reilly) and “Automated Code Remediation” (O’Reilly). He is an Army veteran and two-time bronze star recipient.

Jonathan Fuerth

Theresa Mammarella

Toronto Java Users Group

Technology

Java

Open Source

Software Development

Web Technology

Web Development

Computer Programming

Programming Languages

Mobile Development

J2EE

Java Concurrency

Java Virtual Machine

Server Side Javascript

Distributed Systems

The state of AI in large-scale automated refactoring - Jonathan Schneider

Artificial Intelligence Applications

Free Times Cafe

Share

Toronto Java Users Group

The state of AI in large-scale automated refactoring - Jonathan Schneider

Toronto Java Users Group

Details

Members are also interested in