Critical Thinking

Most people use LLMs by feel: ask a question, read the answer, decide whether it “seems good,” and move on. That works for casual use. It does not work when you are building software, automating workflows, writing important documents, or relying on AI for anything that needs to be repeatable. In this talk, we’ll look at how to improve and evaluate the inputs and outputs of LLMs using practical measurement techniques. We’ll cover how prompt changes affect results, how to compare outputs, how to build simple evaluation sets, and how math-based methods like similarity scoring can help you move beyond guesswork. This will be beginner-friendly, so even if you don't know anything about AI, you should get something out of it. However, this will be a little more technical than our intro talks. You do not need to be an AI researcher, but programmers and technically curious attendees will get a lot out of it. We’ll cover: * Why “it looks good” is not enough * How to improve prompts by changing the input, context, and constraints * How to compare LLM outputs more systematically * Basic evaluation techniques for accuracy, consistency, and usefulness * How embeddings, cosine similarity, and scoring can help evaluate results * Where automated evaluation works — and where humans still need to stay in the loop By the end, you’ll have a practical mental model for treating LLMs less like magic and more like systems you can test, measure, and improve. LOGISTICS AND PARKING: The talk starts at 7:00 PM. The first half hour is reserved for everyone to get set up and mingle. Free pizza and drinks! The cheapest parking option is to find street parking, which will only cost you a few bucks. Otherwise, park in the nearby veteran's museum lot for $8. It's highly recommended you avoid the nearby $15 garage parking.

Be prepared for an entirely different type of sci-fi movie! Unofficially, the second movie in director Lars von Trier's "Depression Trilogy," 2011 Melancholia depicts the events that occur before a rogue planet is about to collide with the earth. Considered by many to be a masterpiece, the film was included in BFI's 2022 Sight and Sound Poll of the greatest movies of all time. It is available at the library as well as on Kanopy.

Sleep in on Sundays. When you've had your fill of pajama-time, roll out and have some tasty brunch with your fellow Humanists!

We'll meet at The Capital One Café, 167 Easton Town Center, Space A-103. This is in the main mall where the Microsoft store used to be, on your left if you're standing at the bottom of the AMC Theater escalator. Join us on Saturday for an hour of uninterrupted wordmaking! • What we'll do Join us for an hour of writing! We’ve discovered that it’s strikingly helpful to write with other writers. See if it’s true for you at 10AM on Saturday mornings. Be it a book, blog, script, essay, dissertation, resume, melody, poem or just plain work stuff, you are invited to write it with us. No one will see what you've written or give you unsolicited advice. Instead of just thinking about writing, come and get some real writing done. SCHEDULE: 10:00 - SESSION 1: quick intros. 10:10 - timer starts: write for 1 hour. 11:10 - chat / take off / keep writing. OPTIONAL SOCIALIZING happens at 11A-11:30ish. Writing is very solitary. Connecting (and sometimes even commiserating) with other writers is a cool thing. BEING LATE IS OKAY: just show up and get settled, then check-in with me after the session. (I’ll be the person with the Shut Up & Write! sign.) If you were on time, please be willing to make room for the friendly latecomer. Happy writing and I look forward to seeing you! • What to bring Whatever you need to be able to write! Bring earbuds/earplugs if you want to block noise or the occasional conversation by other patrons. Electrical outlets are limited, so charge your devices before whenever possible. See you at The Café on Saturday!

You can sleep in on the Sesquicentennial (observed), we’re shifting to the following Friday. But join the local UX community for a chat and some biscuits to catch up. If you were in CA for Figma Config, tell us all the lines and you can tell me how I can animate an SVG without coding it by hand, and why I’d even want to. Thanks to the team at Nationwide of supporting the group.