Physics-inspired Generative AI models via real hardware-based noisy quantum diffusion
summary
The gist
The gist: This work proposes physics-inspired protocols, including quantum stochastic walks and exploiting intrinsic noise in real IBM quantum hardware, to improve image generation quality using
In short
The research proposes physics-inspired Quantum Diffusion Models (QDMs) to improve image generation quality for MNIST. They tested a hybrid quantum-classical stochastic walk dynamics, showing it produces statistically more robust models with lower Fréchet Inception Distance (FID) than purely classical methods. Furthermore, they demonstrated an algorithm that exploits the intrinsic noise of real IBM quantum hardware to generate images.
Key concepts
- Quantum Stochastic Walks (QSWs)
- These are mathematical models used to describe how a particle moves randomly in a quantum system. In this context, they replace classical diffusion dynamics in image generation processes. The dynamics involve evolving a categorical data sample on a cycle graph representing image categories, with hybrid scenarios blending quantum and classical movement.
- Fréchet Inception Distance (FID)
- FID is a metric used to evaluate the quality of generated images by comparing them to real images from the training set. A lower FID score indicates that the generated samples are statistically more similar to the original data, signifying higher image generation quality.
- Exploiting Intrinsic Noise
- This approach uses the inherent noise present in actual, noisy quantum hardware (like IBM QPU) as a useful resource rather than something to be eliminated. The researchers showed that injecting controlled noise into the quantum walk dynamics helps create better generative models, suggesting noise can be leveraged in Quantum Generative AI.
- Hybrid Quantum-Classical Dynamics
- This refers to a model where the diffusion process combines quantum evolution with classical elements. By tuning a parameter ($\omega$), researchers found that this hybrid approach outperformed both the purely quantum and purely classical diffusion dynamics in terms of image generation quality.
Terminology used across episodes
This episode discusses
- Physics-inspired Generative AI models via real hardware-based noisy quantum diffusion · Paper Radio
- Adam: A Method for Stochastic Optimization
The paper
Physics-inspired Generative AI models via real hardware-based noisy quantum diffusion · Read on arXiv
Department of Physics and Astronomy, University of Florence · LENS - European Laboratory for Non-Linear Spectroscopy, University of Florence · Department of Engineering, University Pompeu Fabra
Quantum Diffusion Models (QDMs) are an emerging paradigm in Generative AI that aims to use quantum properties to improve the performances of their classical counterparts. However, existing algorithms are not easily scalable due to the limitations of near-term quantum devices. Following our previous work on QDMs, here we propose and implement two physics-inspired protocols. In the first, we use the formalism of quantum stochastic walks, showing that a specific interplay of quantum and classical dynamics in the forward process produces statistically more robust models generating sets of MNIST images with lower Fréchet Inception Distance (FID) than using totally classical dynamics. In the second approach, we realize an algorithm to generate images by exploiting the intrinsic noise of real IBM quantum hardware with only four qubits. Our work could be a starting point to pave the way for new scenarios for large-scale algorithms in quantum Generative AI, where quantum noise is neither mitigated nor corrected, but instead exploited as a useful resource.
DOI: 10.1007/s42484-026-00459-5
Transcript
Introduction to the show: ident: Quantum Radio. Generated commentary on the latest quantum physics and condensed matter papers.
Kai: Today's paper: "Physics-inspired Generative AI models via real hardware-based noisy quantum diffusion".
Mira: The gist: This work proposes physics-inspired protocols, including quantum stochastic walks and exploiting intrinsic noise in real IBM quantum hardware,
Kai: First, who's behind it and why it matters.
Title and authors: Kai: So, so this paper is about Physics-inspired Generative AI models via real hardware-based noisy quantum diffusion. It's looking at how we can use some physics ideas to make these diffusion models better.
Mira: Right, it’s exploring the idea of using quantum properties to improve classical generative algorithms that are already doing pretty well, like diffusion models for images and audio synthesis
six–eight: <ref:2505.22193#pg2,images and audio synthesis 6–8>.
Kai: Exactly. The core idea here is replacing or integrating classical diffusion dynamics with something more quantum mechanical in the forward process. We're talking about quantum stochastic walks, or QSWs.
Lev: So, we’re looking at how these quantum dynamics affect image generation quality when we compare them to classical diffusion models <ref:2505.22193#pg3>.
Kai: Right. The paper uses the formalism of continuous-time QSW dynamics described by the Kossakowski–Lindblad-Gorini master equation sixty-seven seventy-six <ref:2505.22193#pg3>. They model a categorical data sample as a quantum stochastic walker evolving on a cycle graph of eight nodes representing the sample categories.
Mira: It sounds like they’re mapping the data structure onto this specific quantum walk setup, which is quite interesting for image generation <ref:2505.22193#pg1>.
Kai: And they look at how this dynamics changes performance on MNIST, scaling pixel grayscale levels from zero to seven instead of two hundred fifty-five.
Lev: So the naive question a listener might have is, what's the real difference between using these quantum walks versus just sticking with classical diffusion chains <ref:2505.22193#pg3>?
Kai: Well, they investigate how different QSW dynamics impact the generation of new samples. They define a forward process where they sample positions of the walker at each time step based on categorical distributions.
Mira: Then, for the backward process, they use a Multilayer Perceptron to take as input the one-hot encoding of all the walkers' positions at time t and predict their position at time t minus one <ref:2505.22193#pg3>.
Kai: When they compare it to classical methods, they compute the FID metric, which assesses image quality. They found that for a hybrid quantum-classical stochastic dynamics with omega equals zero point three, the mean value of the FID is lower than in the classical case with omega equals one.
Title and authors: Lev: That suggests that this hybrid model is statistically more robust when compared to its classical counterpart <ref:2505.22193#pg3>.
Mira: And they noted that all simulations for omega equals zero point three, except for one outlier, resulted in better FIDs than half of the runs for omega equals one. That points towards a real benefit in sample quality here.
Kai: Now, let's talk about how this is actually being built on hardware. The second approach implements an algorithm to generate images by exploiting the intrinsic noise of real IBM quantum hardware with only four qubits <ref:2505.22193#pg1>.
Lev: So, we’re talking about using four qubits on a real device to generate twenty-eight by twenty-eight grayscale MNIST images normalized to eight gray values <ref:2505.22193#pg1>. That seems like a very constrained setup for image generation.
Kai: They frame the hybrid QSW dynamics as a quantum walker interacting with an external environment that introduces noise, which is efficiently implemented on a cycle graph using the quantum circuit from Razzoli et al fifty.
Mira: And they injected this noise using delay operations expressed in seconds, which they chose to scale in analogy to the cosine schedule of noise in the classical diffusion model by Nichols et al eighty-six <ref:2505.22193#pg3>.
Lev: From an error correction standpoint, injecting noise like that with delay operations is a very specific way to introduce decoherence, and they tie it directly into the classical scheduling ideas.
Kai: They also mention that the invariant property of the graph lets them independently run walkers for single pixels starting from the same initial state and then remap the outcome to specific pixel colors, which makes it scalable in terms of image size with respect to other QDMs.
Mira: So, what’s on this page is showing how you can use noise as a resource in the context of QGenAI instead of just seeing it as something detrimental to quantum algorithms <ref:2505.22193#pg1>.
Lev: It’s interesting that they suggest this approach allows for generating images of any size by harnessing the topology and connectivity of the QPU itself.
Kai: We can see how this connects to other work, like how they are using Qiskit ninety-five, QuTiP ninety-six, and PyTorch ninety-seven for simulation and training, which shows it’s a practical implementation path.
Title and authors: Mira: It really emphasizes that the performance improvement comes from the interplay between the quantum and classical dynamics rather than just one thing working perfectly by itself.
Lev: It’s also interesting to see how they are using real hardware like ibm brisbane, where they trained their model with six thousand nine hundred three full-size twenty-eight by twenty-eight MNIST images of digit zero eighty-seven.
Kai: So, we have seen that the hybrid QSW diffusion dynamics produces sets of samples with a lower FID and is statistically more robust than its classical counterpart. This is a key finding in this paper.
Mira: And the final comparison in Figure S2 shows that generation with QW on ibm brisbane results in a higher FID of three hundred fifty-two compared to the hybrid QSW-based model with an FID of one hundred fourteen. That’s a significant difference.
Lev: So what this means for us is that we can see a practical quantum advantage in generative modeling for data-limited scenarios, even on real noisy hardware <ref:2505.22193#pg3>.
Kai: The paper concludes by showing how noise can be used as a resource in the context of QGenAI and not only be a detrimental factor for quantum algorithms. They suggest that future research could focus on integrating the QPU topology with the quantum walk implemented at the circuit level.
Mira: It’s an interesting outlook, especially considering how they are proposing to use error correction or mitigation techniques to better control the level of noise in the quantum forward process <ref:2505.22193#pg1>.
Lev: It's a necessary direction because controlling that noise level is what will really allow us to push these capabilities further for applications in things like quantum sensing or chemistry.
Kai: So, we’ve seen how this model leverages the specific noise profile of a real IBM QPU to generate high-quality data, proving that physical systems can be engineered into generative AI resources.
Mira: It shows that physics-inspired models are not just theoretical exercises; they have tangible results when you introduce the complexities of real hardware noise.
Lev: So, this paper on physics-inspired Generative AI models via real hardware-based noisy quantum diffusion really highlights how noise can be a resource in the context of QGenAI.
The paper's summary: Kai: So, this paper is about taking those quantum stochastic walks we talked about and actually putting them into practice on real hardware to generate images, which is pretty wild stuff for generative AI.
Mira: Exactly. They’re showing that instead of just using a perfect classical model, you can use the inherent noise in a real IBM quantum processor as a resource to make the generated pictures better.
Lev: From my side, it’s interesting because they are talking about scaling this up—they claim this method lets you generate images of any size by looking at the specific topology of that quantum processor.
Kai: Right. They use something called a hybrid QSW dynamic where the quantum walk is interacting with an external environment, which is basically noise, and they’ve implemented it on a cycle graph using existing quantum circuits from other work to keep things efficient.
Mira: And the main thing they prove, even when comparing it to just the classical approach, is that this hybrid model actually produces lower FID scores for image quality. They found that with omega equals zero point three, the generated samples are statistically more robust than what you get from a purely classical diffusion chain with omega equals one.
Lev: And they put this on real hardware—ibm brisbane—where they trained their model on thousands of full-size MNIST images, and the results show that the quantum walk approach generates samples with a higher FID score, three hundred fifty-two compared to just the hybrid model which got an FID of one hundred fourteen.
Kai: That difference between three hundred fifty-two and one hundred fourteen is pretty significant. It shows that harnessing this noise profile from the actual quantum chip gives you better generative results than just using a purely hybrid stochastic model on the same hardware.
Mira: But there’s a caveat to keep in mind, Kai. They are using only four qubits for the twenty-eight by twenty-eight grayscale images, and they are injecting this noise using delay operations that are expressed in seconds, which they tie into the cosine schedule from classical diffusion models.
Lev: That noise injection method is specific because it’s a time-delayed interaction, so if you were trying to run this on a different type of quantum processor with different connectivity, you might not be able to use the exact same circuit structure easily.
Kai: Exactly. The paper notes that they are using the invariant property of the graph to let them run those walkers for individual pixels independently and then remap it back into the final pixel colors, which is what makes it scalable for bigger images later on.
Mira: So, what this means for us in terms of generative AI is that we’re looking at a new way to use the imperfections in quantum hardware—the noise—as a tool rather than just something to be eliminated when we build these models.
Lev: It suggests that for certain types of problems, like QGenAI, where you need high fidelity but aren't ready for full error correction, using the intrinsic hardware noise could actually lead to improved sample quality.
Kai: It’s definitely a departure from just treating quantum noise as an enemy in these kinds of algorithms. We have to think about it as something that can be harnessed if you know how to map the quantum walk dynamics onto the specific physical layout of your chip.
The paper's improvements: Kai: So, we’re looking at what the authors suggest as improvements to this hybrid quantum diffusion model using real hardware noise <ref:2505.22193#pg1>.
Mira: They are basically proposing that they can use error correction or mitigation techniques to better control the level of noise in that quantum forward process, which is a really important step for making these things reliable.
Lev: From my view, that makes sense because right now, we’re mostly dealing with just injecting this noise and hoping for the best on NISQ devices; controlling it actively changes how good the output will be.
Kai: Right. The paper hints that by better managing that quantum noise level, you could push the capabilities of the backward network even further than what they achieved in their simulation runs.
Mira: And that directly impacts image generation quality because if you can tame the noise effectively, those FID scores we saw earlier—like the one hundred fourteen for hybrid models—could potentially get much lower.
Lev: That’s a big thing because controlling the noise lets you move closer to a situation where these generative models are actually useful for more complex tasks, not just simple MNIST digits.
Kai: It suggests that this isn't just about tweaking the dynamics; it’s about figuring out how to engineer the physical environment of the quantum walk itself to get better results.
Mira: And they also mention that a future direction involves a major integration of the QPU topology with this quantum walk, which means using the actual physical layout of your chip to design that noise and dynamics.
Lev: If you can map it correctly, then you could potentially generate images of any size, not just twenty-eight by twenty-eight like they did in their current experiment.
Kai: So the next step is taking that topological understanding—that way the graph is connected in a certain way—and using that to design a more powerful generation protocol for larger datasets.
Mira: It’s about moving from just generating small, specific images to having a model capable of handling much bigger data distributions without losing quality.
Lev: That sounds like it could open up new avenues for things that require high-fidelity data synthesis, maybe even in simulating physical systems where the noise characteristics are very important.
Kai: So they’re pushing toward making this a more scalable system by tying the theoretical graph structure directly to the physical connectivity of the quantum processor.
Conclusion: Kai: So we’ve seen how combining quantum stochastic walks with real hardware noise in this paper allows them to generate images of MNIST better than just classical methods, even on a noisy IBM QPU <ref:2505.22193#pg1>.
Mira: It really highlights that the way you model the forward process—whether it's purely quantum or hybrid—has a real measurable effect on the final image quality, which we see in those lower FID scores.
Lev: From an error correction angle, it confirms that exploiting hardware noise isn't just a theoretical curiosity; when you actually run this on ibm brisbane with six thousand nine hundred three images of digit zero, you get tangible results that beat the purely hybrid simulation.
Kai: Exactly. It’s not just about the theory; it’s about seeing those numbers on a real quantum chip and realizing they are better than what you get from just running the algorithm on a simulator.
Mira: This paper shows how noise can function as a resource in generative AI, which means we should start thinking less about eliminating noise entirely and more about how to exploit its specific properties for certain tasks.
Lev: I think the future work they suggest, focusing on integrating the QPU topology with the quantum walk circuit level, is where things get interesting for practical applications down the road.
Kai: Right. So we’re moving from just generating small images to designing a protocol that uses the specific physical layout of a chip to make those generative models more powerful and scalable.
Mira: It seems like this work on "Physics-inspired Generative AI models via real hardware-based noisy quantum diffusion" is laying some groundwork for how we can build more robust generative systems that are aware of their underlying physical constraints.
Lev: For me, it's a good reminder that even in the NISQ era, using the specific noise profile of a processor like ibm brisbane can give you an advantage over generic classical models.
Kai: It’s definitely a lot to think about when we look at how we design these models for real-world use.
Mira: Next time, we'll be looking at something completely different, so stick around to see what other ideas are coming out of the arXiv pile.
More episodes
- 2605.23546-Multi-flux Aharonov-Bohm caging with tunable couplings
- 2505.12639-Emergence of the electronic states driven by quantum charge fluctuations in electron doped cuprate superconductors
- 2502.17572-Information-theoretic principle of emergent 1-form symmetries
- 2404.15403-Proof of a Universal Speed Limit on Fast Scrambling in Quantum Systems
- 2405.05093-A Hierarchical Approach to Quantum Many-Body Systems in Non-Markovian Environments
- 2407.16107-Efficient variational quantum eigensolver methodologies on quantum processors
- 2409.11435-Size and Shape of Fuzzy Spheres from Matrix/Membrane Correspondence
- 2409.12820-Machine-learning based high-bandwidth magnetic sensing
- 2502.06570-Erasing Photon-Number Correlations through Hong-Ou-Mandel Interference
- 2410.05878-Exponential entanglement advantage in sensing correlated noise