English
Related papers

Related papers: Two-stage and Lagrangian Dual Decision Rules for M…

200 papers

This paper presents a novel transformation-proximal bundle algorithm for multistage adaptive robust optimization problems. By partitioning recourse decisions into state and control decisions, the proposed algorithm applies affine control…

Optimization and Control · Mathematics 2020-02-06 Chao Ning , Fengqi You

We study the computational complexity certification of inexact gradient augmented Lagrangian methods for solving convex optimization problems with complicated constraints. We solve the augmented Lagrangian dual problem that arises from the…

Optimization and Control · Mathematics 2013-02-19 Valentin Nedelcu , Ion Necoara , Quoc Tran Dinh

In distributed machine learning, efficient training across multiple agents with different data distributions poses significant challenges. Even with a centralized coordinator, current algorithms that achieve optimal communication complexity…

Machine Learning · Computer Science 2024-08-13 Junchi Yang , Murat Yildirim , Qiu Feng

We reconsider the stochastic (sub)gradient approach to the unconstrained primal L1-SVM optimization. We observe that if the learning rate is inversely proportional to the number of steps, i.e., the number of times any training pattern is…

Machine Learning · Computer Science 2014-01-28 Constantinos Panagiotakopoulos , Petroula Tsampouka

In this work we study binary two-stage robust optimization problems with objective uncertainty. We present an algorithm to calculate efficiently lower bounds for the binary two-stage robust problem by solving alternately the underlying…

Optimization and Control · Mathematics 2020-01-17 Nicolas Kämmerling , Jannis Kurtz

Stochastic and (distributionally) robust optimization problems often become computationally challenging as the number of scenarios or data points increases. Scenario reduction is therefore a key technique for improving tractability. We…

Optimization and Control · Mathematics 2026-03-10 Kevin-Martin Aigner , Sebastian Denzler , Frauke Liers , Sebastian Pokutta , Kartikey Sharma

The main focus of this paper is radius-based (supplier) clustering in the two-stage stochastic setting with recourse, where the inherent stochasticity of the model comes in the form of a budget constraint. In addition to the standard…

Data Structures and Algorithms · Computer Science 2024-04-09 Brian Brubach , Nathaniel Grammel , David G. Harris , Aravind Srinivasan , Leonidas Tsepenekas , Anil Vullikanti

A large number of objectives have been proposed to train latent variable generative models. We show that many of them are Lagrangian dual functions of the same primal optimization problem. The primal problem optimizes the mutual information…

Machine Learning · Statistics 2018-07-10 Shengjia Zhao , Jiaming Song , Stefano Ermon

We examine stability properties of primal-dual gradient flow dynamics for composite convex optimization problems with multiple, possibly nonsmooth, terms in the objective function under the generalized consensus constraint. The proposed…

Optimization and Control · Mathematics 2026-01-14 Ibrahim K. Ozaslan , Panagiotis Patrinos , Mihailo R. Jovanović

This paper presents a novel robust trajectory optimization method for constrained nonlinear dynamical systems subject to unknown bounded disturbances. In particular, we seek optimal control policies that remain robustly feasible with…

Systems and Control · Electrical Eng. & Systems 2025-04-08 Arshiya Taj Abdul , Augustinos D. Saravanos , Evangelos A. Theodorou

Robust optimization is a popular paradigm for modeling and solving two- and multi-stage decision-making problems affected by uncertainty. In many real-world applications, the time of information discovery is decision-dependent and the…

Optimization and Control · Mathematics 2022-08-24 Phebe Vayanos , Angelos Georghiou , Han Yu

We study a new two-time-scale stochastic gradient method for solving optimization problems, where the gradients are computed with the aid of an auxiliary variable under samples generated by time-varying MDPs controlled by the underlying…

Optimization and Control · Mathematics 2024-08-27 Sihan Zeng , Thinh T. Doan , Justin Romberg

We study the problem of computing an optimal large language model (LLM) policy for the constrained alignment problem, where the goal is to maximize a primary reward objective while satisfying constraints on secondary utilities. Despite the…

Machine Learning · Computer Science 2025-11-27 Botong Zhang , Shuo Li , Ignacio Hounie , Osbert Bastani , Dongsheng Ding , Alejandro Ribeiro

We consider a risk-averse stochastic capacity planning problem under uncertain demand in each period. Using a scenario tree representation of the uncertainty, we formulate a multistage stochastic integer program to adjust the capacity…

Optimization and Control · Mathematics 2024-11-05 Xian Yu , Siqian Shen

Distributionally robust stochastic optimization (DRSO) is a framework for decision-making problems under certainty, which finds solutions that perform well for a chosen set of probability distributions. Many different approaches for…

Optimization and Control · Mathematics 2017-01-17 Rui Gao , Anton J. Kleywegt

We propose smoothed primal-dual algorithms for solving stochastic and smooth nonconvex optimization problems with linear inequality constraints. Our algorithms are single-loop and only require a single stochastic gradient based on one…

Optimization and Control · Mathematics 2025-04-11 Ruichuan Huang , Jiawei Zhang , Ahmet Alacaoglu

In this paper, we revisit the portfolio optimization problems of the minimization/maximization of investment risk under constraints of budget and investment concentration (primal problem) and the maximization/minimization of investment…

Portfolio Management · Quantitative Finance 2018-01-17 Daichi Tada , Hisashi Yamamoto , Takashi Shinzato

This paper develops an active sensing framework for designing the transmit and receive beamformers of a multiple-input multiple-output (MIMO) radar system. In the proposed technique, the beamformers are adaptively designed in each sensing…

Signal Processing · Electrical Eng. & Systems 2026-04-21 Nadim Ghaddar , Kareem M. Attiah , Wei Yu

Multistage stochastic programming is a powerful tool allowing decision-makers to revise their decisions at each stage based on the realized uncertainty. However, in practice, organizations are not able to be fully flexible, as decisions…

Optimization and Control · Mathematics 2024-01-17 Sezen Ece Kayacık , Beste Basciftci , Albert H Schrotenboer , Evrim Ursavas

This paper introduces a novel approach to contextual stochastic optimization, integrating operations research and machine learning to address decision-making under uncertainty. Traditional methods often fail to leverage contextual…

Machine Learning · Computer Science 2025-05-09 Louis Bouvier , Thibault Prunet , Vincent Leclère , Axel Parmentier