English
Related papers

Related papers: Faster Convex Optimization: Simulated Annealing wi…

200 papers

This paper presents a novel stochastic gradient descent algorithm for constrained optimization. The proposed algorithm randomly samples constraints and components of the finite sum objective function and relies on a relaxed logarithmic…

Optimization and Control · Mathematics 2025-05-13 Naum Dimitrieski , Jing Cao , Christian Ebenbauer

We present a totally asynchronous algorithm for convex optimization that is based on a novel generalization of Nesterov's accelerated gradient method. This algorithm is developed for fast convergence under "total asynchrony," i.e., allowing…

Optimization and Control · Mathematics 2024-06-17 Ellie Pond , April Sebok , Zachary Bell , Matthew Hale

We introduce a concept that generalizes several different notions of a "centerpoint" in the literature. We develop an oracle-based algorithm for convex mixed-integer optimization based on centerpoints. Further, we show that algorithms based…

Optimization and Control · Mathematics 2017-01-19 Amitabh Basu , Timm Oertel

Learning-to-rank is an applied domain of supervised machine learning. As feature selection has been found to be effective for improving the accuracy of learning models in general, it is intriguing to investigate this process for…

Machine Learning · Computer Science 2023-10-23 Mohd. Sayemul Haque , Md. Fahim , Muhammad Ibrahim

In this paper we propose an annealing based framework to incorporate inequality constraints in optimization problems such as facility location, simultaneous facility location with path optimization, and the last mile delivery problem. These…

Optimization and Control · Mathematics 2020-02-11 Amber Srivastava , Gabriel Barsi Haberfeld , Naira Hovakimyan , Srinivasa M Salapaka

We propose a novel adaptive, accelerated algorithm for the stochastic constrained convex optimization setting. Our method, which is inspired by the Mirror-Prox method, \emph{simultaneously} achieves the optimal rates for smooth/non-smooth…

Optimization and Control · Mathematics 2019-10-31 Ali Kavis , Kfir Y. Levy , Francis Bach , Volkan Cevher

We propose an asynchronous, decentralized algorithm for consensus optimization. The algorithm runs over a network in which the agents communicate with their neighbors and perform local computation. In the proposed algorithm, each agent can…

Optimization and Control · Mathematics 2017-03-06 Tianyu Wu , Kun Yuan , Qing Ling , Wotao Yin , Ali H. Sayed

This paper aims to address distributed optimization problems over directed and time-varying networks, where the global objective function consists of a sum of locally accessible convex objective functions subject to a feasible set…

Optimization and Control · Mathematics 2020-07-14 Xiuxian Li , Gang Feng , Lihua Xie

Capacity expansions as well as its reduction have been widely anticipated as important countermeasures for traffic congestion. Although capacity expansion had been traditionally well noticed as a congestion mitigation measure, but it was…

Systems and Control · Computer Science 2018-02-07 Bahman Moghimi , Navid Kalantari , Camille Kamga , Kyriacos Mouskos

This paper considers distributed online optimization with time-varying coupled inequality constraints. The global objective function is composed of local convex cost and regularization functions and the coupled constraint function is the…

Optimization and Control · Mathematics 2019-06-06 Xinlei Yi , Xiuxian Li , Lihua Xie , Karl H. Johansson

We study alternating first-order algorithms with no inner loops for solving nonconvex-strongly-concave min-max problems. We show the convergence of the alternating gradient descent--ascent algorithm method by proposing a substantially…

Optimization and Control · Mathematics 2026-03-31 Guido Tapia-Riera , Camille Castera , Nicolas Papadakis

A stochastic-gradient-based interior-point algorithm for minimizing a continuously differentiable objective function (that may be nonconvex) subject to bound constraints is presented, analyzed, and demonstrated through experimental results.…

Optimization and Control · Mathematics 2024-03-15 Frank E. Curtis , Vyacheslav Kungurtsev , Daniel P. Robinson , Qi Wang

We present a convex optimization framework for overcoming the limitations of Kubernetes Cluster Autoscaler by intelligently allocating diverse cloud resources while minimizing costs and fragmentation. Current Kubernetes scaling mechanisms…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-03-28 Shayan Boghani , Emin Kirimlioglu , Amrita Moturi , Hao-Ting Tso

Devising efficient algorithms that track the optimizers of continuously varying convex optimization problems is key in many applications. A possible strategy is to sample the time-varying problem at constant rate and solve the resulting…

Optimization and Control · Mathematics 2017-11-28 Andrea Simonetto

Convex optimization methods are employed to optimize a real-time (RT) system-on-chip (SoC) under a variety of physical resource-driven constraints, demonstrated on an industry MPEG2 encoder SoC. The power optimization is compared to…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-05-22 L. Yavits , A. Morad , R. Ginosar , U. Weiser

Geometric numerical integration has recently been exploited to design symplectic accelerated optimization algorithms by simulating the Lagrangian and Hamiltonian systems from the variational framework introduced in Wibisono et al. In this…

Optimization and Control · Mathematics 2023-05-19 Valentin Duruisseaux , Melvin Leok

A canonical approach to approximating the partition function of a Gibbs distribution via sampling is simulated annealing. This method has led to efficient reductions from counting to sampling, including: $\bullet$ classic non-adaptive…

Data Structures and Algorithms · Computer Science 2026-04-07 Hongyang Liu , Yitong Yin , Yiyao Zhang

Parallelization is a popular strategy for improving the performance of iterative algorithms. Optimization methods are no exception: design of efficient parallel optimization methods and tight analysis of their theoretical properties are…

Optimization and Control · Mathematics 2023-11-28 Alexander Tyurin , Peter Richtárik

Using convex combination and linesearch techniques, we introduce a novel primal-dual algorithm for solving structured convex-concave saddle point problems with a generic smooth nonbilinear coupling term. Our adaptive linesearch strategy…

Optimization and Control · Mathematics 2024-01-17 Xiaokai Chang , Junfeng Yang , Hongchao Zhang

We develop an optimization algorithm, using simulated annealing for the quantification of patterns in astronomical data based on techniques developed for robotic vision applications. The methodology falls in the category of cost…

Instrumentation and Methods for Astrophysics · Physics 2020-09-09 Maria Chira , Manolis Plionis