Quality, Speed, and Scale: three key attributes to measure the performance of near-term quantum computers

Andrew Wack, Hanhee Paik, Ali Javadi-Abhari, Petar Jurcevic, Ismael Faro, Jay Gambetta, Blake Johnson

arXiv (Cornell University) · 2021 · 12 citations · 0 references

DOIFull text

Open access

Concepts

TL;DR

Defining the right metrics to properly represent the performance of a quantum computer is critical to both users and developers of a computing system. The paper identifies quality, speed, and scale as the three key attributes of quantum computing performance and proposes a speed benchmark based on Circuit Layer Operations Per Second (CLOPS). Quality is measured by quantum volume, scale by the number of qubits, and speed by the CLOPS benchmark, for which the authors prescribe a measurement procedure and apply it to IBM Quantum systems. Using the CLOPS procedure, the authors characterize the performance of several IBM Quantum systems, demonstrating its applicability.

Abstract

Defining the right metrics to properly represent the performance of a quantum computer is critical to both users and developers of a computing system. In this white paper, we identify three key attributes for quantum computing performance: quality, speed, and scale. Quality and scale are measured by quantum volume and number of qubits, respectively. We propose a speed benchmark, using an update to the quantum volume experiments that allows the measurement of Circuit Layer Operations Per Second (CLOPS) and identify how both classical and quantum components play a role in improving performance. We prescribe a procedure for measuring CLOPS and use it to characterize the performance of some IBM Quantum systems.