Researchers from the OpenSuperQPlus consortium, together with partners from the EU-funded MILLENION and SPINUS projects, have contributed to a new scientific publication addressing one of the key challenges in quantum computing: how to measure and compare system performance reliably.
As quantum processors continue to grow in size and complexity, the need for clear, reproducible, and technology-independent benchmarks is becoming increasingly critical. The newly proposed framework responds to this challenge by introducing a set of scalable benchmarks designed to evaluate different aspects of quantum computing systems.
A new framework of Key Performance Indicators
The publication introduces four complementary Key Performance Indicator (KPI) benchmarks that aim to provide a more holistic assessment of quantum devices. These benchmarks go beyond traditional metrics, which are often limited to smaller systems and lack comparability across platforms.
Among them is the so-called “Clifford Volume” benchmark, which measures the effective computational capacity of a quantum system by identifying the largest problem it can solve within acceptable error thresholds. Additional benchmarks address aspects such as entanglement generation, algorithmic performance, and the role of quantum error correction.
By focusing on scalability and platform independence, the framework ensures that performance can be evaluated consistently across different quantum technologies—from current noisy intermediate-scale quantum (NISQ) devices to future fault-tolerant systems.
Supporting transparent progress across Europe’s quantum ecosystem
Establishing shared benchmarks is essential for tracking progress and enabling fair comparisons between different quantum computing approaches. Within the EU Quantum Flagship, Key Performance Indicators play a central role in monitoring technological advancement and guiding research priorities across Europe.
The contribution from OpenSuperQPlus and its partners represents an important step toward more transparent and standardised evaluation methods. By providing a common framework, these benchmarks support the coordinated development of quantum technologies and help accelerate the transition from experimental systems to practical, scalable applications.

