Physical review. E · 2019 · 89 citations · 39 references
Large-scale Global OptimizationCluster ComputingMomentum AnnealingEngineeringComputer ArchitectureConstrained OptimizationComputational ComplexityParallel MetaheuristicsBinary OptimizationSimulated AnnealingIsing ModelIsing ModelsParallel ComputingCombinatorial OptimizationMassively-parallel ComputingComputer EngineeringComputer ScienceAlgorithmic DevelopmentComputational ScienceParallel ProcessingParallel Programming
One of the vital roles of computing is to solve large-scale combinatorial optimization problems in a short time. In recent years, methods have been proposed that map optimization problems to ones of searching for the ground state of an Ising model by using a stochastic process. Simulated annealing (SA) is a representative algorithm. However, it is inherently difficult to perform a parallel search. Here we propose an algorithm called momentum annealing (MA), which, unlike SA, updates all spins of fully connected Ising models simultaneously and can be implemented on GPUs that are widely used for scientific computing. MA running in parallel on GPUs is 250 times faster than SA running on a modern CPU at solving problems involving 100 000 spin Ising models.
39
Optimization by Simulated Annealing
Scott Kirkpatrick, C. D. Gelatt, M.P. Vecchi · Science · 1983 · 44K citations
Numerical Analysis, Large-scale Global Optimization, Computational Science +15
Equation of State Calculations by Fast Computing Machines
N. Metropolis, Arianna W. Rosenbluth, M. N. Rosenbluth et al. · The Journal of Chemical Physics · 1953 · 36.5K citations
Dropout: a simple way to prevent neural networks from overfitting
Nitish Srivastava, Geoffrey E. Hinton, Alex Krizhevsky et al. · 2014 · 34.2K citations
Uncovering the overlapping community structure of complex networks in nature and society
Gergely Palla, Imre Derényi, Illés J. Farkas et al. · Nature · 2005 · 5.4K citations · Full text
Community Network, Community Structure, Network Evolution +12