English
Related papers

Related papers: Hardness of Online Sleeping Combinatorial Optimiza…

200 papers

We propose accelerated randomized coordinate descent algorithms for stochastic optimization and online learning. Our algorithms have significantly less per-iteration complexity than the known accelerated gradient algorithms. The proposed…

Machine Learning · Computer Science 2018-07-17 Akshita Bhandari , Chandramani Singh

We study fault-tolerant consensus in a variant of the synchronous message passing model, where, in each round, every node can choose to be awake or asleep. This is known as the sleeping model (Chatterjee, Gmyr, Pandurangan PODC 2020) and…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-10-31 Shachar Meir , Hugo Mirault , David Peleg , Peter Robinson

We present methods for online linear optimization that take advantage of benign (as opposed to worst-case) sequences. Specifically if the sequence encountered by the learner is described well by a known "predictable process", the algorithms…

Machine Learning · Statistics 2014-05-27 Alexander Rakhlin , Karthik Sridharan

Finding a shortest path in a graph is one of the most classic problems in algorithmic and graph theory. While we dispose of quite efficient algorithms for this ordinary problem (like the Dijkstra or Bellman-Ford algorithms), some slight…

Data Structures and Algorithms · Computer Science 2024-08-05 Abderrahim Bendahi , Adrien Fradin

We study the optimization version of the set partition problem (where the difference between the partition sums are minimized), which has numerous applications in decision theory literature. While the set partitioning problem is NP-hard and…

Data Structures and Algorithms · Computer Science 2021-09-13 Kaan Gokcesu , Hakan Gokcesu

Solving NP-hard/complete combinatorial problems with neural networks is a challenging research area that aims to surpass classical approximate algorithms. The long-term objective is to outperform hand-designed heuristics for…

Neural and Evolutionary Computing · Computer Science 2024-02-14 Dobrik Georgiev , Danilo Numeroso , Davide Bacciu , Pietro Liò

Online optimization has emerged as powerful tool in large scale optimization. In this paper, we introduce efficient online algorithms based on the alternating directions method (ADM). We introduce a new proof technique for ADM in the batch…

Machine Learning · Computer Science 2012-07-03 Huahua Wang , Arindam Banerjee

Much of the work in online learning focuses on the study of sublinear upper bounds on the regret. In this work, we initiate the study of best-case lower bounds in online convex optimization, wherein we bound the largest improvement an…

Machine Learning · Computer Science 2021-06-25 Cristóbal Guzmán , Nishant A. Mehta , Ali Mortazavi

In this paper, we study bottleneck identification in networks via extracting minimax paths. Many real-world networks have stochastic weights for which full knowledge is not available in advance. Therefore, we model this task as a…

Machine Learning · Computer Science 2023-02-15 Niklas Åkerblom , Fazeleh Sadat Hoseini , Morteza Haghir Chehreghani

This paper is devoted to the online dominating set problem and its variants. We believe the paper represents the first systematic study of the effect of two limitations of online algorithms: making irrevocable decisions while not knowing…

Data Structures and Algorithms · Computer Science 2018-09-14 Joan Boyar , Stephan J. Eidenbenz , Lene M. Favrholdt , Michal Kotrbčík , Kim S. Larsen

We consider combinatorial online learning with subset choices when only relative feedback information from subsets is available, instead of bandit or semi-bandit feedback which is absolute. Specifically, we study two regret minimisation…

Machine Learning · Computer Science 2020-02-28 Aadirupa Saha , Aditya Gopalan

We consider robust combinatorial optimization problems where the decision maker can react to a scenario by choosing from a finite set of $k$ solutions. This approach is appropriate for decision problems under uncertainty where the…

Optimization and Control · Mathematics 2019-03-28 André Chassein , Marc Goerigk , Jannis Kurtz , Michael Poss

We consider an online two-stage stochastic optimization with long-term constraints over a finite horizon of $T$ periods. At each period, we take the first-stage action, observe a model parameter realization and then take the second-stage…

Machine Learning · Computer Science 2024-01-03 Piao Hu , Jiashuo Jiang , Guodong Lyu , Hao Su

We present an adaptive online gradient descent algorithm to solve online convex optimization problems with long-term constraints , which are constraints that need to be satisfied when accumulated over a finite number of rounds T , but can…

Machine Learning · Statistics 2015-12-24 Rodolphe Jenatton , Jim Huang , Cédric Archambeau

Training neural networks involves solving large-scale non-convex optimization problems. This task has long been believed to be extremely difficult, with fear of local minima and other obstacles motivating a variety of schemes to improve…

Neural and Evolutionary Computing · Computer Science 2015-05-25 Ian J. Goodfellow , Oriol Vinyals , Andrew M. Saxe

We investigate the distributed DC-Optimal Power Flow (DC-OPF) problem for a dynamic and uncertain environment. The unpredictable supply of renewable resources and varying prices of the electricity market are a few factors responsible for…

Optimization and Control · Mathematics 2023-08-10 Sushobhan Chatterjee , Rachel Kalpana Kalaimani

We study Online Convex Optimization (OCO) with adversarial constraints, where an online algorithm must make sequential decisions to minimize both convex loss functions and cumulative constraint violations. We focus on a setting where the…

Machine Learning · Statistics 2025-03-14 Jordan Lekeufack , Michael I. Jordan

The easy-hard-easy pattern in the difficulty of combinatorial search problems as constraints are added has been explained as due to a competition between the decrease in number of solutions and increased pruning. We test the generality of…

Artificial Intelligence · Computer Science 2008-02-03 D. L. Mammen , T. Hogg

A variant of the well-known Shortest Path Problem is studied in this paper, where pairs of conflicting arcs are provided, and for each conflicting pair a penalty is paid once neither or both of the arcs are selected. This configures a set…

Optimization and Control · Mathematics 2025-06-05 Roberto Montemanni , Derek H. Smith

We analyze Decentralized Online Optimization algorithms using the Performance Estimation Problem approach which allows, to automatically compute exact worst-case performance of optimization algorithms. Our analysis shows that several…

Optimization and Control · Mathematics 2025-09-09 Erwan Meunier , Julien M. Hendrickx