中文
相关论文

相关论文: On the relations of stochastic convex optimization…

200 篇论文

We develop methods to solve general optimal stopping problems with opportunities to stop that arrive randomly. Such problems occur naturally in applications with market frictions. Pivotal to our approach is that our methods operate on…

Consider convex optimization problems subject to a large number of constraints. We focus on stochastic problems in which the objective takes the form of expected values and the feasible set is the intersection of a large number of convex…

机器学习 · 统计学 2015-11-13 Mengdi Wang , Yichen Chen , Jialin Liu , Yuantao Gu

We analyze a simple randomized subgradient method for approximating solutions to stochastic systems of convex functional constraints, the only input to the algorithm being the size of minibatches. By introducing a new notion of what is…

最优化与控制 · 数学 2021-08-30 James Renegar , Song Zhou

Bilevel optimization problems are receiving increasing attention in machine learning as they provide a natural framework for hyperparameter optimization and meta-learning. A key step to tackle these problems is the efficient computation of…

机器学习 · 统计学 2025-05-20 Riccardo Grazzi , Massimiliano Pontil , Saverio Salzo

This paper considers stochastic optimization problems whose objective functions involve powers of random variables. For example, consider the classic Stochastic lp Load Balancing Problem (SLBp): There are $m$ machines and $n$ jobs, and…

数据结构与算法 · 计算机科学 2018-10-15 Marco Molinaro

Consider the problem of minimizing the expected value of a (possibly nonconvex) cost function parameterized by a random (vector) variable, when the expectation cannot be computed accurately (e.g., because the statistics of the random…

多智能体系统 · 计算机科学 2017-12-12 Yang Yang , Gesualdo Scutari , Daniel P. Palomar , Marius Pesavento

We consider stochastic optimization problems which use observed data to estimate essential characteristics of the random quantities involved. Sample average approximation (SAA) or empirical (plug-in) estimation are very popular ways to use…

统计理论 · 数学 2021-03-16 Darinka Dentcheva , Yang Lin

Contextual stochastic optimization is an advanced methodology to model uncertainty in the presence of contextual information during decision planning processes. Although classical methodologies focus on minimizing the expectation of a…

最优化与控制 · 数学 2025-11-24 Man Yiu Tsang , Tony Sit , Hoi Ying Wong

This paper studies empirical risk minimization (ERM) problems for large-scale datasets and incorporates the idea of adaptive sample size methods to improve the guaranteed convergence bounds for first-order stochastic and deterministic…

机器学习 · 计算机科学 2017-09-05 Aryan Mokhtari , Alejandro Ribeiro

Many stochastic optimization problems include chance constraints that enforce constraint satisfaction with a specific probability; however, solving an optimization problem with chance constraints assumes that the solver has access to the…

最优化与控制 · 数学 2021-09-21 Joshua Comden , Ahmed S. Zamzam , Andrey Bernstein

In this paper, we study a class of stochastic and finite-sum convex optimization problems with deterministic constraints. Existing methods typically aim to find an $\epsilon$-$expectedly\ feasible\ stochastic\ optimal$ solution, in which…

最优化与控制 · 数学 2025-06-26 Zhaosong Lu , Yifeng Xiao

In this paper, we consider a class of stochastic optimal control problems with risk constraints that are expressed as bounded probabilities of failure for particular initial states. We present here a martingale approach that diffuses a risk…

系统与控制 · 计算机科学 2015-07-09 Vu Anh Huynh , Leonid Kogan , Emilio Frazzoli

Optimization problems with norm-bounding constraints arise in a variety of applications, including portfolio optimization, machine learning, and feature selection. A common approach to these problems involves relaxing the norm constraint…

最优化与控制 · 数学 2025-05-08 Danial Davarnia , Mohammadreza Kiaghadi

We address an optimization problem where the cost function is the expectation of a random mapping. To tackle the problem two approaches based on the approximation of the objective function by consensus-based particle optimization methods on…

最优化与控制 · 数学 2025-11-24 Sabrina Bonandin , Michael Herty

For shape optimization problems, governed by elliptic equations with Dirichlet boundary condition and random coefficients, we utilize a penalization technique to get the approximate problem. We consider that uncertainties exists in the…

最优化与控制 · 数学 2025-08-26 Xiaowei Pang

We consider large-scale Markov decision processes (MDPs) with an unknown cost function and employ stochastic convex optimization tools to address the problem of imitation learning, which consists of learning a policy from a finite set of…

机器学习 · 计算机科学 2022-01-04 Angeliki Kamoutsi , Goran Banjac , John Lygeros

Variable selection is a fundamental task in statistical data analysis. Sparsity-inducing regularization methods are a popular class of methods that simultaneously perform variable selection and model estimation. The central problem is a…

机器学习 · 计算机科学 2016-03-16 Hongbo Dong , Kun Chen , Jeff Linderoth

In this paper, we consider the problem of stochastic optimization, where the objective function is in terms of the expectation of a (possibly non-convex) cost function that is parametrized by a random variable. While the convergence speed…

信息论 · 计算机科学 2019-10-23 Naeimeh Omidvar , An Liu , Vincent Lau , Danny H. K. Tsang , Mohammad Reza Pakravan

We introduce adaptive sampling methods for stochastic programs with deterministic constraints. First, we propose and analyze a variant of the stochastic projected gradient method where the sample size used to approximate the reduced…

最优化与控制 · 数学 2023-02-07 Florian Beiser , Brendan Keith , Simon Urbainczyk , Barbara Wohlmuth

Many high dimensional sparse learning problems are formulated as nonconvex optimization. A popular approach to solve these nonconvex optimization problems is through convex relaxations such as linear and semidefinite programming. In this…

机器学习 · 统计学 2015-03-17 Zhaoran Wang , Quanquan Gu , Han Liu