# Disordered Systems and Neural Networks (cond-mat.dis-nn)

• Quantum annealers aim at solving non-convex optimization problems by exploiting cooperative tunneling effects to escape local minima. The underlying idea consists in designing a classical energy function whose ground states are the sought optimal solutions of the original optimization problem and add a controllable quantum transverse field to generate tunneling processes. A key challenge is to identify classes of non-convex optimization problems for which of quantum annealing remains efficient while thermal annealing fails. We show that this happens for a wide class of problems which are central to machine learning. Their energy landscapes is dominated by local minima that cause exponential slow down of classical thermal annealers while quantum annealing converges efficiently to rare dense regions of optimal solutions.
• Inferring a generative model from data is a fundamental problem in machine learning. It is well-known that the Ising model is the maximum entropy model for binary variables which reproduces the sample mean and pairwise correlations. Learning the parameters of the Ising model from data is the challenge. We establish an analogy between the inverse Ising problem and the Ornstein-Zernike formalism in liquid state physics. Rather than analytically deriving the closure relation, we use a deep neural network to learn the closure from simulations of the Ising model. We show, using simulations as well as biochemical datasets, that the deep neural network model outperforms systematic field-theoretic expansions and can generalize well beyond the parameter regime of the training data. The neural network is able to learn from synthetic data, which can be generated with relative ease, to give accurate predictions on real world datasets.
• A one-dimensional quantum system with off diagonal disorder, consisting of a sample of conducting regions randomly interspersed within potential barriers is considered. Results mainly concerning the large $N$ limit are presented. In particular, the effect of compression on the transmission coefficient is investigated. A numerical method to simulate such a system, for a physically relevant number of barriers, is proposed. It is shown that the disordered model converges to the periodic case as $N$ increases, with a rate of convergence which depends on the disorder degree. Compression always leads to a decrease of the transmission coefficient which may be exploited to design nano-technological sensors. Effective choices for the physical parameters to improve the sensitivity are provided. Eventually large fluctuations and rate functions are analysed.
• We demonstrate deterministic control over the photon-number distribution by interfering two coherent beams within a disordered photonic lattice. By sweeping a relative phase between two equal-amplitude coherent fields with Poissonian statistics that excite adjacent sites in a lattice endowed with disorder-immune chiral symmetry, we measure an output photon-number distribution that changes periodically between super-thermal and sub-thermal photon statistics upon ensemble averaging. Thus, the photon-bunching level is controlled interferometrically at a fixed mean photon-number by gradually activating the excitation symmetry of the chiral-mode pairs with structured coherent illumination and without modifying the disorder level of the random system itself.
• We introduce a fully automatic self-learning scheme for detecting phase boundaries. This method extends the previously introduced confusion scheme for learning phase transitions, by using a cooperative network that learns to optimize the guess for the transition point. The networks together are capable of finding transition points for fully unlabeled data. This improvement allows us to efficiently study 1D and 2D parameter spaces, where for the latter we utilize an active contour model -- the snake -- from computer vision as a representation of the learned phase boundary. The snakes, equipped with neural networks, can learn while they move in the parameter space and thereby detect phase boundaries automatically.
• Random fields disorder Ising ferromagnets by aligning single spins in the direction of the random field in three space dimensions, or by flipping large ferromagnetic domains at dimensions two and below. While the former requires random fields of typical magnitude similar to the interaction strength, the latter Imry-Ma mechanism only requires infinitesimal random fields. Recently, it has been shown that for dilute anisotropic dipolar systems a third mechanism exists, where the ferromagnetic phase is disordered by finite-size glassy domains at a random field of finite magnitude that is considerably smaller than the typical interaction strength. Using large-scale Monte Carlo simulations and zero-temperature numerical approaches, we show that this mechanism applies to disordered ferromagnets with competing short-range ferromagnetic and antiferromagnetic interactions, suggesting its generality in ferromagnetic systems with competing interactions and an underlying spin-glass phase. A finite-size-scaling analysis of the magnetization distribution suggests that the transition might be first order.
• We present and apply a general-purpose, multi-start algorithm for improving the performance of low-energy samplers used for solving optimization problems. The algorithm iteratively fixes the value of a large portion of the variables to values that have a high probability of being optimal. The resulting problems are smaller and less connected, and samplers tend to give better low-energy samples for these problems. The algorithm is trivially parallelizable, since each start in the multi-start algorithm is independent, and could be applied to any heuristic solver that can be run multiple times to give a sample. We present results for several classes of hard problems solved using simulated annealing, path-integral quantum Monte Carlo, parallel tempering with isoenergetic cluster moves, and a quantum annealer, and show that the success metrics as well as the scaling are improved substantially. When combined with this algorithm, the quantum annealer's scaling was substantially improved for native Chimera graph problems. In addition, with this algorithm the scaling of the time to solution of the quantum annealer is comparable to the Hamze--de Freitas--Selby algorithm on the weak-strong cluster problems introduced by Boixo et al. Parallel tempering with isoenergetic cluster moves was able to consistently solve 3D spin glass problems with 8000 variables when combined with our method, whereas without our method it could not solve any.

Travis Scholten Oct 02 2015 03:25 UTC

No worries with regards to the code - when it does get released, would you mind pinging me? You can find me on [GitHub](https://github.com/Travis-S).

Nicola Pancotti Sep 23 2015 07:58 UTC

Hi Travis

Yes, that code is related to the work we did and that is my repo. However it is quite outdated. I used that repo for sharing the code with my collaborators. Now we are working for providing a human friendly version, commented and possibly optimized. If you would like to have a working

...(continued)
Travis Scholten Sep 21 2015 17:08 UTC

Has anyone found some source code for the SGD referenced in this paper? I came across a [GitHub repository](https://github.com/nicaiola/thesisproject) from Nicola Pancotti (at least, I think that is his username, and the code seems to fit with the kind of work described in the paper!). I am not sure

...(continued)
Salvatore Mandrà Nov 21 2014 13:50 UTC

The manuscript has been widely revised to focus the reader's attention on the proposed method and its application in presence of local disorder.

Best,

Salvatore, Gian Giacomo and Alán

Salvatore Mandrà Aug 01 2014 19:11 UTC

Thanks Dr. Hastings for your comment. It is true that the transverse field Ising model does not satisfy the requirements to apply our method with an exponential reduction. Indeed, the opposite would be quite impressive since the random Ising model is a NP-Hard problem and we ourselves would be prett

...(continued)
Matt Hastings Aug 01 2014 16:43 UTC

The "quite general" conditions seem not to include the transverse field Ising model, the subject of most of the intensive numerical work previously. Incidentally, the terms "Lanczos" and "Krylov subspace" might be helpful.