English
Related papers

Related papers: Differentiability and Regularization of Parametric…

200 papers

In this note, we study a class of stochastic control problems where the optimal strategies are described by two parameters. These include a subset of singular control, impulse control, and two-player stochastic games. The parameters are…

Optimization and Control · Mathematics 2016-05-18 Kazutoshi Yamazaki

It is well known that for any finite state Markov decision process (MDP) there is a memoryless deterministic policy that maximizes the expected reward. For partially observable Markov decision processes (POMDPs), optimal memoryless policies…

Optimization and Control · Mathematics 2016-02-16 Guido Montufar , Keyan Ghazi-Zahedi , Nihat Ay

In performative prediction, the choice of a model influences the distribution of future data, typically through actions taken based on the model's predictions. We initiate the study of stochastic optimization for performative prediction.…

Machine Learning · Computer Science 2021-02-22 Celestine Mendler-Dünner , Juan C. Perdomo , Tijana Zrnic , Moritz Hardt

Constrained decision-making is essential for designing safe policies in real-world control systems, yet simulated environments often fail to capture real-world adversities. We consider the problem of learning a policy that will maximize the…

Machine Learning · Computer Science 2026-02-10 Sourav Ganguly , Kishan Panaganti , Arnob Ghosh , Adam Wierman

Program behavior may depend on parameters, which are either configured before compilation time, or provided at run-time, e.g., by sensors or other input devices. Parametric program analysis explores how different parameter settings may…

Programming Languages · Computer Science 2014-06-23 Thomas M. Gawlitza , Martin D. Schwarz , Helmut Seidl

We consider a risk-averse stochastic capacity planning problem under uncertain demand in each period. Using a scenario tree representation of the uncertainty, we formulate a multistage stochastic integer program to adjust the capacity…

Optimization and Control · Mathematics 2024-11-05 Xian Yu , Siqian Shen

We investigate the dual of a Multistage Stochastic Linear Program (MSLP) to study two questions for this class of problems. The first of these questions is the study of the optimal value of the problem as a function of the involved…

Optimization and Control · Mathematics 2020-10-06 Vincent Guigues , Alexander Shapiro , Yi Cheng

Data valuation has become a cornerstone of the modern data economy, where datasets function as tradable intellectual assets that drive decision-making, model training, and market transactions. Despite substantial progress, existing…

Machine Learning · Statistics 2025-12-25 Zhangyong Liang , Ji Zhang , Xin Wang , Pengfei Zhang , Zhao Li

The stochastic subgradient method is a widely-used algorithm for solving large-scale optimization problems arising in machine learning. Often these problems are neither smooth nor convex. Recently, Davis et al. [1-2] characterized the…

Optimization and Control · Mathematics 2021-02-25 Shixiang Chen , Alfredo Garcia , Shahin Shahrampour

Sequential convex programming has been established as an effective framework for solving nonconvex trajectory planning problems. However, its performance is highly sensitive to problem parameters, including trajectory variables, algorithmic…

Optimization and Control · Mathematics 2025-12-09 Ziqi Xu , Lin Cheng , Di Wu , Shengping Gong

In this paper, we focus on a data-driven risk-averse multistage stochastic programming (RMSP) model considering distributional robustness. We optimize the RMSP over the worst-case distribution within an ambiguity set of probability…

Optimization and Control · Mathematics 2017-08-29 Jianqiu Huang , Kezhuo Zhou , Yongpei Guan

We consider the problem of computing a positive definite $p \times p$ inverse covariance matrix aka precision matrix $\theta=(\theta_{ij})$ which optimizes a regularized Gaussian maximum likelihood problem, with the elastic-net regularizer…

Statistics Theory · Mathematics 2015-09-02 Yves F. Atchadé , Rahul Mazumder , Jie Chen

(Stochastic) bilevel optimization is a frequently encountered problem in machine learning with a wide range of applications such as meta-learning, hyper-parameter optimization, and reinforcement learning. Most of the existing studies on…

Machine Learning · Computer Science 2023-03-16 Meng Ding , Mingxi Lei , Yunwen Lei , Di Wang , Jinhui Xu

The solution to a stochastic optimal control problem can be determined by computing the value function from a discretization of the associated Hamilton-Jacobi-Bellman equation. Alternatively, the problem can be reformulated in terms of a…

Optimization and Control · Mathematics 2024-02-29 Sebastian Reich

This paper presents an analytical method for calculating the operational value of an energy storage device under multi-stage price uncertainties. Our solution calculates the storage value function from price distribution functions directly…

Optimization and Control · Mathematics 2024-03-29 Bolun Xu , Audun Botterud , Magnus Korpas

Given an infeasible, unbounded, or pathological convex optimization problem, a natural question to ask is: what is the smallest change we can make to the problem's parameters such that the problem becomes solvable? In this paper, we address…

Optimization and Control · Mathematics 2020-01-30 Shane Barratt , Guillermo Angeris , Stephen Boyd

In this paper, we study a stochastic recursive optimal control problem in which the cost functional is described by the solution of a backward stochastic differential equation driven by G-Brownian motion. Under standard assumptions, we…

Optimization and Control · Mathematics 2014-10-15 Mingshang Hu , Shaolin Ji

Finding valuable training data points for deep neural networks has been a core research challenge with many applications. In recent years, various techniques for calculating the "value" of individual training datapoints have been proposed…

Machine Learning · Computer Science 2021-04-29 Soumi Das , Arshdeep Singh , Saptarshi Chatterjee , Suparna Bhattacharya , Sourangshu Bhattacharya

In this paper we introduce a class of novel distributed algorithms for solving stochastic big-data convex optimization problems over directed graphs. In the addressed set-up, the dimension of the decision variable can be extremely high and…

Optimization and Control · Mathematics 2020-10-06 Francesco Farina , Giuseppe Notarstefano

In this paper, we investigate the problem of stochastic multi-level compositional optimization, where the objective function is a composition of multiple smooth but possibly non-convex functions. Existing methods for solving this problem…

Machine Learning · Computer Science 2022-10-20 Wei Jiang , Bokun Wang , Yibo Wang , Lijun Zhang , Tianbao Yang