English
Related papers

Related papers: Increasing the attraction area of the global minim…

200 papers

In this paper we accomplish the development of the fast rank-adaptive solver for tensor-structured symmetric positive definite linear systems in higher dimensions. In [arXiv:1301.6068] this problem is approached by alternating minimization…

Numerical Analysis · Mathematics 2014-10-07 Sergey V. Dolgov , Dmitry V. Savostyanov

We consider the problem of sparse coding, where each sample consists of a sparse linear combination of a set of dictionary atoms, and the task is to learn both the dictionary elements and the mixing coefficients. Alternating minimization is…

Machine Learning · Computer Science 2014-07-30 Alekh Agarwal , Animashree Anandkumar , Prateek Jain , Praneeth Netrapalli

We consider a modification of the OMM energy functional which contains an $\ell^1$ penalty term in order to find a sparse representation of the low-lying eigenspace of self-adjoint operators. We analyze the local minima of the modified…

Numerical Analysis · Mathematics 2017-03-08 Jianfeng Lu , Kyle Thicke

We address an optimization problem where the cost function is the expectation of a random mapping. To tackle the problem two approaches based on the approximation of the objective function by consensus-based particle optimization methods on…

Optimization and Control · Mathematics 2025-11-24 Sabrina Bonandin , Michael Herty

We report a study of the basins of attraction for potential energy minima defined by different minimisation algorithms for an atomic system. We find that whereas some minimisation algorithms produce compact basins, others produce basins…

Computational Physics · Physics 2013-10-01 Daniel Asenjo , Jacob D. Stevenson , David J. Wales , Daan Frenkel

To provide a novel tool for the investigation of the energy landscape of the Edwards-Anderson spin-glass model we introduce an algorithm that allows an efficient execution of a greedy optimization based on data from a previously performed…

Disordered Systems and Neural Networks · Physics 2023-12-01 Stefan Schnabel , Wolfhard Janke

Finding parameters that minimise a loss function is at the core of many machine learning methods. The Stochastic Gradient Descent algorithm is widely used and delivers state of the art results for many problems. Nonetheless, Stochastic…

Machine Learning · Computer Science 2018-09-26 Yao Zhang , Andrew M. Saxe , Madhu S. Advani , Alpha A. Lee

A class of algorithms for the solution of discrete material optimization problems in electromagnetic applications is discussed. The idea behind the algorithm is similar to that of the sequential programming. However, in each major iteration…

Optimization and Control · Mathematics 2017-07-14 Johannes Semmler , Lukas Pflug , Michael Stingl

Like most multiobjective combinatorial optimization problems, biobjective optimization problems on matroids are in general intractable and their corresponding decision problems are in general NP-hard. In this paper, we consider biobjective…

Data Structures and Algorithms · Computer Science 2022-03-15 Jochen Gorski , Kathrin Klamroth , Julia Sudhoff

The subspace selection problem seeks a subspace that maximizes an objective function under some constraint. This problem includes several important machine learning problems such as the principal component analysis and sparse dictionary…

Data Structures and Algorithms · Computer Science 2018-05-22 So Nakashima , Takanori Maehara

Binary optimization is a central problem in mathematical optimization and its applications are abundant. To solve this problem, we propose a new class of continuous optimization techniques which is based on Mathematical Programming with…

Optimization and Control · Mathematics 2017-12-07 Ganzhao Yuan , Bernard Ghanem

The search for global minima is a critical challenge across multiple fields including engineering, finance, and artificial intelligence, particularly with non-convex functions that feature multiple local optima, complicating optimization…

Quantum Physics · Physics 2025-03-13 Mohammadreza Soltaninia , Junpeng Zhan

Several standard processes for searching minima of potential functions, such as thermodynamical strategies (simulated annealing) and biologically motivated selfreproduction strategies, are reduced to Schr\"odinger problems. The properties…

adap-org · Physics 2008-02-03 Torsten Asselmeyer , Werner Ebeling

In this work, we study the tensor ring decomposition and its associated numerical algorithms. We establish a sharp transition of algorithmic difficulty of the optimization problem as the bond dimension increases: On one hand, we show the…

Numerical Analysis · Mathematics 2020-06-17 Ziang Chen , Yingzhou Li , Jianfeng Lu

Quadratic constrained quadratic programming problems often occur in various fields such as engineering practice, management science, and network communication. This article mainly studies a non convex quadratic programming problem with…

Optimization and Control · Mathematics 2023-12-29 Bo Zhang , YueLin Gao , Xia Liu , XiaoLi Huang

(NxN)-matrix is called additive when its elements are pair-wise sums of N real numbers. For a quadratic binary functional with an additive connection matrix we succeeded in finding the global minimum expressing it through external…

Disordered Systems and Neural Networks · Physics 2009-07-16 Leonid Litinskii

We consider global optimization problems, where the feasible region $\X$ is a compact subset of $\mathbb{R}^d$ with $d \geq 10$. For these problems, we demonstrate the following. First: the actual convergence of global random search…

Optimization and Control · Mathematics 2023-02-27 Jack Noonan , Anatoly Zhigljavsky

Recent advancements in quantum computing and quantum-inspired algorithms have sparked renewed interest in binary optimization. These hardware and software innovations promise to revolutionize solution times for complex problems. In this…

We present a random-subspace variant of cubic regularization algorithm that chooses the size of the subspace adaptively, based on the rank of the projected second derivative matrix. Iteratively, our variant only requires access to…

Optimization and Control · Mathematics 2025-01-09 Edward Tansley , Coralia Cartis

Predicting which crystalline modifications can be present in a chemical system requires the global exploration of its energy landscape. Due to the large computational effort involved, in the past this search for sufficiently stable minima…

Materials Science · Physics 2017-09-13 K. Doll , J. C. Schön , M. Jansen