Quantum Algorithms Database
Quantum Belief Propagation
A quantum generalization of the classical belief propagation algorithm used for probabilistic inference in graphical models, relevant to both quantum error correction and quantum machine learning.
Year
2007 (Hastings; Leifer and Poulin); 2008 (publication)
Inventor(s)
Matthew Hastings; Matthew Leifer and David Poulin
Speedup Type
Heuristic (No Proven Speedup)
Difficulty
★★★★★
Overview
Belief propagation is a classical method for computing probabilities in networks of related variables, such as the models used in speech recognition, error-correcting codes, and image analysis. Each node passes messages to its neighbors summarizing what it believes about shared variables, and after a few rounds of message passing the nodes agree on the marginal probabilities. On tree-shaped networks the answer is exact, and on networks with loops it is often a good approximation.
Quantum belief propagation carries the idea over to quantum systems, where the variables are quantum and the probabilities become density matrices. It is mostly an algorithm run on classical computers to study quantum states, and it also shows up in the decoding of quantum error-correcting codes. It is not a quantum speedup in itself.
The problem it solves
Efficiently estimating probabilities in complex networks of interdependent variables — a core task in classical statistical inference and machine learning.
History and background
Classical belief propagation was developed by Judea Pearl in 1982 for Bayesian networks, and it was recognized in the 2000s as the same algorithm used to decode low-density parity-check codes, with a theory of its approximations from Yedidia, Freeman, and Weiss through the Bethe free energy. In 2007 Matthew Hastings introduced a quantum version for thermal states of quantum lattice systems, and Matthew Leifer and David Poulin extended it to general quantum graphical models in a paper published in Annals of Physics in 2008.
Poulin and Bilgin applied the method in 2008 to compute correlation functions of quantum systems on loopy graphs. In parallel, belief propagation became a practical tool for quantum error correction: Panteleev and Kalachev and Roffe and colleagues showed around 2020 and 2021 that decoders combining belief propagation with ordered statistics post-processing work well for quantum LDPC codes, and similar decoders have been developed for hardware roadmaps by groups such as IBM.
How it works
Generalizes classical message-passing inference rules to quantum states, propagating quantum 'belief' information across a network structure to estimate quantum marginal probabilities.
In a classical graphical model, the joint probability of many variables factors into small pieces, each involving a few neighbors. To find the probability of one variable, you would have to sum over all the others, which is exponentially expensive. Belief propagation avoids that by having each variable send its neighbors a message that summarizes everything it has learned from the rest of the network, and updating messages until they stop changing.
The quantum case adds a difficulty. Quantum operators on neighboring pieces generally do not commute, so the neat factorization of probabilities no longer holds. Leifer and Poulin replaced the factorization with a notion of quantum conditional independence defined through the quantum conditional mutual information, which vanishes for states with the structure of a quantum Markov chain. For such states, local quantum messages can be defined and passed in the same way.
On trees this gives exact marginals under the right structural assumptions, and on loopy graphs it gives approximations whose quality depends on correlations decaying with distance. Hastings's version uses a similar message structure to correct the errors that arise when a thermal state is approximated by local pieces.
Step by step
- Represent the system as a graph, with each node carrying a quantum variable and each edge or hyperedge carrying an interaction term in the Hamiltonian or a factor in the quantum state.
- Initialize a quantum message, a positive operator, on each directed edge, typically the identity.
- Update each message by combining the local factor with the messages from all other neighbors, and then tracing out the variables that are not shared with the receiving node.
- Repeat the message updates across the graph until they converge, or for a fixed number of rounds.
- Compute the approximate marginal density matrix for each node or small cluster from the incoming messages and its local factor.
- Use the marginals to estimate local observables, correlation functions, or free energies, or in the decoder case, to estimate which errors most likely occurred.
A worked example
Consider a chain of quantum spins at finite temperature with nearest-neighbor interactions. Exact calculation of the reduced state of one spin would require handling a matrix whose size grows exponentially with the chain length. Quantum belief propagation passes operator-valued messages from left to right and right to left along the chain, each of the size of a single spin's state space, and combines them at each site.
For a quantum LDPC code, the decoder treats the parity checks as a graph. Each check sends a message to the qubits it involves, and each qubit sends a message back, with values representing the belief that an error occurred. After some rounds, the qubits with highest error probability are corrected. Here the algorithm is classical belief propagation applied to the syndrome, and its quantum features come from how the checks are structured.
Complexity and resources
| Item | Detail |
|---|---|
| Cost per message update | Polynomial in the local variable dimension and the number of neighbors |
| Exactness | Exact for tree-structured quantum Markov networks; approximate on loopy graphs |
| Total cost | Linear in the number of nodes for each round, with a modest number of rounds |
| Accuracy | Depends on correlation decay and on the strength of loops |
| Quantum hardware | Not required for the basic algorithm; it is a classical method for quantum states |
What hardware it needs
- A classical computer for the basic algorithm and for decoders.
- For decoder use, fast classical hardware coupled to the quantum device in real time.
- No quantum hardware is needed for the algorithm itself.
Applications
- Approximating thermal states, correlation functions, and free energies of quantum lattice systems.
- Decoding quantum LDPC codes, often together with post-processing steps such as ordered statistics decoding.
- Quantum probabilistic inference and quantum graphical models.
- Studying how correlations propagate in quantum networks.
Limitations and caveats
- On loopy graphs, belief propagation can fail to converge or converge to wrong answers, especially with strong correlations or frustration.
- The quantum version requires conditions, such as the Markov property, that real states satisfy only approximately.
- It does not provide a quantum speedup. It helps classical computers handle certain quantum problems.
- For decoding, degenerate quantum codes cause problems that need extra techniques.
Common misconceptions
- Quantum belief propagation is not an algorithm that runs faster on a quantum computer. It is a message-passing algorithm for quantum states.
- It is not always exact. Exactness holds for tree structures and special states.
How it compares
- Classical belief propagation is the commutative special case.
- Tensor network methods such as DMRG and PEPS offer other ways to approximate many-body states.
- For quantum error correction, minimum-weight matching decoders are used for surface codes, while belief propagation suits LDPC codes.
Real-world impact
Has direct applications in decoding certain quantum error-correcting codes, connecting classical inference theory to practical quantum error correction implementations.
Why it matters
Message passing is a unifying idea across error correction, statistical physics, and machine learning, and quantum belief propagation shows how far it extends. Its use in decoding is directly relevant to the next generation of quantum error-correcting codes.
It is also a reminder that useful algorithms in quantum computing do not always run on quantum hardware. Classical algorithms that handle quantum information are part of the ecosystem.
Frequently asked questions
What is quantum belief propagation?
A message-passing algorithm that approximates marginals, correlations, and thermal properties of quantum systems arranged on a graph.
Does it need a quantum computer?
No. It is a classical algorithm for quantum states, although related ideas are used in decoders for quantum error correction.
Who developed it?
Matthew Hastings introduced a version for thermal states in 2007, and Matthew Leifer and David Poulin generalized it to quantum graphical models in 2008.
How is it used in error correction?
Belief propagation decoders, often combined with ordered statistics, infer likely errors from syndromes for quantum LDPC codes.
When does it fail?
On graphs with strong loops and long-range correlations, where messages may not converge or may give inaccurate marginals.
Keep learning
- Related algorithm: Quantum Error-Correcting Codes (Shor Code, Surface Code)
- Related algorithm: Quantum Gibbs Sampling
- Related algorithm: Quantum Boltzmann Machine (QBM)
- Related algorithm: Quantum Metropolis Algorithm
This page is written for educational purposes. Complexity statements describe the best known results at the time of review (September 30, 2026), and research in this area moves quickly, so check recent papers before relying on a specific bound.