English
Related papers

Related papers: Efficient Multi-Start Strategies for Local Search …

200 papers

The minmax multiple traveling salesman problem involves minimizing the longest tour among a set of tours. The problem is of great practical interest because it can be used to formulate several real-life applications. To solve this…

Neural and Evolutionary Computing · Computer Science 2024-03-20 Pengfei He , Jin-Kao Hao , Jinhui Xia

Multi-time-scale stochastic approximation is an iterative algorithm for finding the fixed point of a set of $N$ coupled operators given their noisy samples. It has been observed that due to the coupling between the decision variables and…

Optimization and Control · Mathematics 2024-09-13 Sihan Zeng , Thinh T. Doan

We develop and analyze stochastic optimization algorithms for problems in which the expected loss is strongly convex, and the optimum is (approximately) sparse. Previous approaches are able to exploit only one of these two structures,…

Machine Learning · Statistics 2012-07-19 Alekh Agarwal , Sahand Negahban , Martin J. Wainwright

Motivated by broad applications in reinforcement learning and federated learning, we study local stochastic approximation over a network of agents, where their goal is to find the root of an operator composed of the local operators at the…

Machine Learning · Computer Science 2020-06-25 Thinh T. Doan

Among sub-optimal Multi-Agent Path Finding (MAPF) solvers, rule-based algorithms are particularly appealing since they are complete. Even in crowded scenarios, they allow finding a feasible solution that brings each agent to its target,…

Multiagent Systems · Computer Science 2024-10-11 Irene Saccani , Stefano Ardizzoni , Luca Consolini , Marco Locatelli

We study a sequential resource allocation problem involving a fixed number of recurring jobs. At each time-step the manager should distribute available resources among the jobs in order to maximise the expected number of completed jobs.…

Machine Learning · Computer Science 2014-06-17 Tor Lattimore , Koby Crammer , Csaba Szepesvári

A number of prototypical optimization problems in multi-agent systems (e.g., task allocation and network load-sharing) exhibit a highly local structure: that is, each agent's decision variables are only directly coupled to few other agent's…

Multiagent Systems · Computer Science 2020-03-04 Robin Brown , Federico Rossi , Kiril Solovey , Michael T. Wolf , Marco Pavone

Among sub-optimal MAPF solvers, rule-based algorithms are particularly appealing since they are complete. Even in crowded scenarios, they allow finding a feasible solution that brings each agent to its target, preventing deadlock…

Optimization and Control · Mathematics 2024-04-10 S. Ardizzoni , I. Saccani , L. Consolini , M. Locatelli

The mean completion time of a stochastic process may be rendered finite and minimised by a judiciously chosen restart protocol, which may either be stochastic or deterministic. Here we study analytically an arbitrary stochastic search…

Quantitative Methods · Quantitative Biology 2016-09-14 Kabir Husain , Sandeep Krishna

We develop and analyze a set of new sequential simulation-optimization algorithms for large-scale multi-dimensional discrete optimization via simulation problems with a convexity structure. The "large-scale" notion refers to that the…

Optimization and Control · Mathematics 2022-01-20 Haixiang Zhang , Zeyu Zheng , Javad Lavaei

Sequential quadratic optimization algorithms are proposed for solving smooth nonlinear optimization problems with equality constraints. The main focus is an algorithm proposed for the case when the constraint functions are deterministic,…

Optimization and Control · Mathematics 2020-07-22 Albert Berahas , Frank E. Curtis , Daniel P. Robinson , Baoyu Zhou

Most work on sequential learning assumes a fixed set of actions that are available all the time. However, in practice, actions can consist of picking subsets of readings from sensors that may break from time to time, road segments that can…

Machine Learning · Computer Science 2026-04-29 Gergely Neu , Michal Valko

Hybrid quantum-classical algorithms such as the quantum approximate optimization algorithm (QAOA) are considered one of the most promising approaches for leveraging near-term quantum computers for practical applications. Such algorithms are…

Quantum Physics · Physics 2022-06-16 Ruslan Shaydulin , Ilya Safro , Jeffrey Larson

We consider the classical problem of sequential resource allocation where a decision maker must repeatedly divide a budget between several resources, each with diminishing returns. This can be recast as a specific stochastic optimization…

Machine Learning · Statistics 2020-01-17 Xavier Fontaine , Shie Mannor , Vianney Perchet

We develop tools for analyzing focused stochastic local search algorithms. These are algorithms which search a state space probabilistically by repeatedly selecting a constraint that is violated in the current state and moving to a random…

Discrete Mathematics · Computer Science 2015-08-18 Dimitris Achlioptas , Fotis Iliopoulos

The popularity of Bayesian optimization methods for efficient exploration of parameter spaces has lead to a series of papers applying Gaussian processes as surrogates in the optimization of functions. However, most proposed approaches only…

Machine Learning · Statistics 2015-10-16 Javier González , Zhenwen Dai , Philipp Hennig , Neil D. Lawrence

By analyzing accelerated proximal gradient methods under a local quadratic growth condition, we show that restarting these algorithms at any frequency gives a globally linearly convergent algorithm. This result was previously known only for…

Optimization and Control · Mathematics 2019-10-04 Olivier Fercoq , Zheng Qu

Multidimensional optimization problems where the objective function and the constraints are multiextremal non-differentiable Lipschitz functions (with unknown Lipschitz constants) and the feasible region is a finite collection of robust…

Optimization and Control · Mathematics 2015-03-19 Yaroslav D. Sergeyev , Paolo Pugliese , Domenico Famularo

In a multi-armed bandit problem, an online algorithm chooses from a set of strategies in a sequence of trials so as to maximize the total payoff of the chosen strategies. While the performance of bandit algorithms with a small finite…

Data Structures and Algorithms · Computer Science 2019-04-16 Robert Kleinberg , Aleksandrs Slivkins , Eli Upfal

In real-world optimization scenarios, the problem instance that we are asked to solve may change during the optimization process, e.g., when new information becomes available or when the environmental conditions change. In such situations,…

Neural and Evolutionary Computing · Computer Science 2022-09-12 Nina Bulanova , Arina Buzdalova , Carola Doerr