hardware algorithms simulation sensing

CLOPS: Benchmarking System Speed at Utility Scale

Curator's Take

AI Commentary

This article introduces CLOPS_h, a new “circuit‑layer operations per second” metric that finally lets the community quantify how fast a quantum processor can sustain utility‑scale workloads without sacrificing fidelity. By tying speed to layered, hardware‑aware circuits and the same layer‑fidelity framework used for quality benchmarks, it bridges the gap between today’s focus on gate error rates and the throughput demands of variational algorithms and error‑mitigated simulations. The benchmark gives developers a realistic performance ceiling (MCPS) to target as devices move beyond a few dozen qubits, though its relevance will depend on how well hardware vendors adopt the standardized layer decomposition in their reporting.

— Mark Eatherly

Summary

As quantum processors scale to hundreds of qubits, execution speed is a critical performance dimension alongside scale and quality. While substantial progress has been made in benchmarking circuit fidelity, existing speed metrics often fail to reflect the sustained, end-to-end throughput experienced by users running utility-scale workloads. This shortfall is especially pronounced for layered, parameterized circuits executed repeatedly within classical-quantum workflows, such as variational algorithms and error-mitigated simulations. In this work, we formalize CLOPS_h (Circuit Layer Operations Per Second) as a holistic speed benchmark defined over layered, hardware-aware circuits. CLOPS_h measures the sustained rate at which the system executes physical layers, parallel slices of qubit-disjoint two-qubit gates separated by synchronization barriers. Because each such layer is one time slice of an N-qubit circuit, this rate maps directly to the execution rate of layered $N$-qubit circuits, connecting CLOPS_h to published device capability claims, and to the device-level throughput ceiling we formalize as Max Circuits Per Second (MCPS). CLOPS_h is obtained under layer-fidelity operating conditions, binding the speed measurement to an independently verified quality envelope, and it shares its layer decomposition with scalable layer-fidelity (LF) quality benchmarks, enabling coherent interpretation of speed and quality without conflating the two.