English
Related papers

Related papers: Faster Convex Optimization: Simulated Annealing wi…

200 papers

We consider the problem of optimizing an approximately convex function over a bounded convex set in $\mathbb{R}^n$ using only function evaluations. The problem is reduced to sampling from an \emph{approximately} log-concave distribution…

Numerical Analysis · Computer Science 2020-07-27 Alexandre Belloni , Tengyuan Liang , Hariharan Narayanan , Alexander Rakhlin

Optimization is finding the best solution, which mathematically amounts to locating the global minimum of some cost function. Optimization is traditionally automated with digital or quantum computers, each having their limitations and none…

Statistical Mechanics · Physics 2021-11-16 Natalia B. Janson , Christopher J. Marsden

Quadratic constrained quadratic programming problems often occur in various fields such as engineering practice, management science, and network communication. This article mainly studies a non convex quadratic programming problem with…

Optimization and Control · Mathematics 2023-12-29 Bo Zhang , YueLin Gao , Xia Liu , XiaoLi Huang

This paper studies the problem of mapping optimization in decentralized control problems. A global optimization algorithm is proposed based on the ideas of ``deterministic annealing" - a powerful non-convex optimization framework derived…

Systems and Control · Computer Science 2014-03-24 Mustafa Mehmetoglu , Emrah Akyol , Kenneth Rose

Aligning partially overlapping point sets where there is no prior information about the value of the transformation is a challenging problem in computer vision. To achieve this goal, we first reduce the objective of the robust point…

Computer Vision and Pattern Recognition · Computer Science 2020-07-07 Wei Lian , WangMeng Zuo , Lei Zhang

In a recent paper, Skajaa and Ye proposed a homogeneous primal-dual interior-point method for non-symmetric conic optimization. The authors showed that their algorithm converges to $\varepsilon$-accuracy in $O(\sqrt{\nu}\log…

Optimization and Control · Mathematics 2018-06-18 Dávid Papp , Sercan Yıldız

This paper considers online convex optimization with time-varying constraint functions. Specifically, we have a sequence of convex objective functions $\{f_t(x)\}_{t=0}^{\infty}$ and convex constraint functions…

Optimization and Control · Mathematics 2017-02-20 Michael J. Neely , Hao Yu

This paper presents a novel method for reformulating non-differentiable collision avoidance constraints into smooth nonlinear constraints using strong duality of convex optimization. We focus on a controlled object whose goal is to avoid…

Optimization and Control · Mathematics 2018-06-12 Xiaojing Zhang , Alexander Liniger , Francesco Borrelli

In this paper, distributed convex optimization problem over non-directed dynamical networks is studied. Here, networked agents with single-integrator dynamics are supposed to rendezvous at a point that is the solution of a global convex…

Optimization and Control · Mathematics 2017-07-18 Amir Adibzadeh , Mohsen Zamani , Amir A. Suratgar , Mohammad B. Menhaj

The connections between (convex) optimization and (logconcave) sampling have been considerably enriched in the past decade with many conceptual and mathematical analogies. For instance, the Langevin algorithm can be viewed as a sampling…

Data Structures and Algorithms · Computer Science 2024-03-25 Yunbum Kook , Santosh S. Vempala

This study combines simulated annealing with delta evaluation to solve the joint stratification and sample allocation problem. In this problem, atomic strata are partitioned into mutually exclusive and collectively exhaustive strata. Each…

Artificial Intelligence · Computer Science 2021-11-23 Mervyn O'Luing , Steven Prestwich , S. Armagan Tarim

This paper proposes an infeasible interior-point algorithm for the convex optimization problem using arc-search techniques. The proposed algorithm simultaneously selects the centering parameter and the step size, aiming at optimizing the…

Optimization and Control · Mathematics 2024-03-12 Yaguang Yang

In a Hilbert setting, for convex differentiable optimization, we develop a general framework for adaptive accelerated gradient methods. They are based on damped inertial dynamics where the coefficients are designed in a closed-loop way.…

Optimization and Control · Mathematics 2025-01-28 Hedy Attouch , Radu Ioan Bot , Dang-Khoa Nguyen

We develop a family of accelerated stochastic algorithms that minimize sums of convex functions. Our algorithms improve upon the fastest running time for empirical risk minimization (ERM), and in particular linear least-squares regression,…

Machine Learning · Statistics 2015-06-25 Roy Frostig , Rong Ge , Sham M. Kakade , Aaron Sidford

Tensor networks have proven to be a valuable tool, for instance, in the classical simulation of (strongly correlated) quantum systems. As the size of the systems increases, contracting larger tensor networks becomes computationally…

Quantum Physics · Physics 2025-07-29 Manuel Geiger , Qunsheng Huang , Christian B. Mendl

Many important challenges in science and technology can be cast as optimization problems. When viewed in a statistical physics framework, these can be tackled by simulated annealing, where a gradual cooling procedure helps search for…

Disordered Systems and Neural Networks · Physics 2024-01-17 Mohamed Hibat-Allah , Estelle M. Inack , Roeland Wiersema , Roger G. Melko , Juan Carrasquilla

This paper studies distributed online convex optimization with time-varying coupled constraints, motivated by distributed online control in network systems. Most prior work assumes a separability condition: the global objective and coupled…

Optimization and Control · Mathematics 2026-02-18 Zhaoye Pan , Haozhe Lei , Fan Zuo , Zilin Bian , Tao Li

This paper develops a new global optimisation method that applies to a family of criteria that are not entirely known. This family includes the criteria obtained from the class of posteriors that have nor-malising constants that are…

Statistics Theory · Mathematics 2019-07-16 R. Stoica , Madalina Deaconu , Anne Philippe , Lluis Hurtado

Many problems in statistical learning, imaging, and computer vision involve the optimization of a non-convex objective function with singularities at the boundary of the feasible set. For such challenging instances, we develop a new…

Optimization and Control · Mathematics 2019-11-07 Pavel Dvurechensky , Mathias Staudigl , César A. Uribe

We propose a new randomized optimization method for high-dimensional problems which can be seen as a generalization of coordinate descent to random subspaces. We show that an adaptive sampling strategy for the random subspace significantly…

Optimization and Control · Mathematics 2019-12-19 Jonathan Lacotte , Mert Pilanci , Marco Pavone