Title: Benchmarking Quantum Computers with a Unified Framework
Abstract: As quantum hardware continues to advance across a growing landscape of vendors, it is increasingly important to evaluate device capabilities for specific computational tasks. However, cross-platform benchmarking remains challenging due to diverse hardware architectures, proprietary access interfaces, and the lack of standardized benchmarking frameworks. In this talk, we will give a review of existing quantum benchmarking tools, highlighting the challenges in the field and then introduce metriq-gym, an open-source Python framework designed to facilitate both system-level and application-level benchmarking of quantum devices across multiple providers. We will then provide an overview of the metriq-gym architecture and demonstrate its capabilities through a curated set of benchmark results obtained from several leading quantum hardware devices.
Speaker: Changhao Li received his Ph.D. from MIT in 2023, where his research focused on quantum sensing and control using solid-state spin defects in diamond. He then joined the quantum computing team at JPMorgan, where he worked on developing quantum algorithms for optimization and machine learning. Currently, Dr. Li is with the Unitary Foundation focusing on building open-source tools for benchmarking quantum hardware.