PSAISuiteBenchmarks: Benchmark Any AI Model from PowerShell — Live Demo

Which AI model is fastest? Most instruction-compliant? Best at reasoning?

I built PSAISuiteBenchmarks — a benchmark suite that runs standardized
tests across 15 AI providers in parallel and prints a leaderboard.

One command. Real results. No opinions.

👉 Repo: https://github.com/dfinke/psaisuite

In this session I'll demo it live:
- Run InstructionFollowing, Reasoning, CodeGen, and Latency benchmarks
- Show real findings: where models fail and why it matters for agent pipelines
- Walk through how it was built in a single session using Claude + Copilot

Built on top of psaisuite — PowerShell's unified interface to 15 AI providers.

Bring your questions. Results will surprise you.

About Doug
Doug Finke is a 16-time Microsoft MVP and creator of the PowerShell AI module — chat in your console, NLP in your scripts — plus other popular tools like PowerShell + Excel integration.
With 40+ years in tech (from punch cards to AI), Doug now focuses on the next evolution: building autonomous tools and showing others how to think, type, get with AI — not just code around it.