Quantum-assisted learning of graphical models with arbitrary pairwise connectivity


Mainstream machine learning techniques such as deep learning and probabilistic programming rely heavily on sampling from generally intractable probability distributions. There is increasing interest in the potential advantages of using quantum computing technologies as sampling engines to speed up these tasks. However, some pressing challenges in state-of-the-art quantum annealers have to be overcome before we can assess their actual performance. The sparse connectivity, resulting from the local interaction between quantum bits in physical hardware implementations, is considered the most severe limitation to the quality of constructing powerful machine learning models. Here we show how to surpass this bottleneck and illustrate our findings by training probabilistic generative models with arbitrary pairwise connectivity on a real dataset of handwritten digits and two synthetic datasets in experiments with up to $940$ quantum bits. Our model can be trained in quantum hardware without full knowledge of the effective parameters specifying the corresponding quantum Boltzmann-like distribution. Therefore, the need to infer the effective temperature at each iteration is avoided, speeding up learning, and the effect of noise in the control parameters is mitigated, improving accuracy. Our approach demonstrates the feasibility of using quantum annealers for implementing generative models of real datasets and provides a suitable framework for benchmarking these quantum technologies on tasks qualitatively different from the traditional ones.
Submitted 8 Sep 2016 to Quantum Physics [quant-ph]
Published 9 Sep 2016
Updated 18 May 2017
Subjects: quant-ph cs.LG
Author comments: 15 pages, 8 figures. New extensive experiments and simulations. Also included further discussion on the possibility of training quantum models with our the gray-box model and on the implementation in other architectures such as the LHZ scheme. Two figures were added as well to illustrate the machine learning task under consideration and its experimental realization

1 comment

Omar Shehab Sep 12 2016 12:50 UTC

I am still trying to understand the following statement from II.A.

> This leads to the condition that the first- and second-order moments
> of the model and data distributions should be equal for the parameters
> to be optimal.