English
Related papers

Related papers: Risk averse constrained blackbox optimization unde…

200 papers

Black-box variational inference is widely used in situations where there is no proof that its stochastic optimization succeeds. We suggest this is due to a theoretical gap in existing stochastic optimization proofs: namely the challenge of…

Machine Learning · Computer Science 2023-12-25 Justin Domke , Guillaume Garrigos , Robert Gower

We consider active learning (AL) in an uncertain environment in which trade-off between multiple risk measures need to be considered. As an AL problem in such an uncertain environment, we study Mean-Variance Analysis in Bayesian…

Machine Learning · Statistics 2020-09-18 Shogo Iwazaki , Yu Inatsu , Ichiro Takeuchi

This paper presents a new approach and algorithm for solving a class of constrained Bi-Level Optimization (BLO) problems in which the lower-level problem involves constraints coupling both upper-level and lower-level variables. Such…

Machine Learning · Computer Science 2024-01-30 Wei Yao , Chengming Yu , Shangzhi Zeng , Jin Zhang

Bayesian optimisation has proven to be a powerful tool for expensive global black-box optimisation problems. In this paper, we propose new Bayesian optimisation variants of the popular Knowledge Gradient acquisition functions for problems…

Machine Learning · Computer Science 2025-12-22 Xietao Wang Lin , Juan Ungredda , Max Butler , James Town , Alma Rahat , Hemant Singh , Juergen Branke

Risk-averse decision-making under uncertainty in partially observable domains is a central challenge in artificial intelligence and is essential for developing reliable autonomous agents. The formal framework for such problems is the…

Statistics Theory · Mathematics 2026-02-27 Yaacov Pariente , Vadim Indelman

We study the problem of incorporating risk while making combinatorial decisions under uncertainty. We formulate a discrete submodular maximization problem for selecting a set using Conditional-Value-at-Risk (CVaR), a risk metric commonly…

Robotics · Computer Science 2022-03-21 Lifeng Zhou , Pratap Tokekar

Multistage risk-averse optimal control problems with nested conditional risk mappings are gaining popularity in various application domains. Risk-averse formulations interpolate between the classical expectation-based stochastic and minimax…

Optimization and Control · Mathematics 2019-03-19 Pantelis Sopasakis , Mathijs Schuurmans , Panagiotis Patrinos

We consider a non-convex constrained Lagrangian formulation of a fundamental bi-criteria optimization problem for variable selection in statistical learning; the two criteria are a smooth (possibly) nonconvex loss function, measuring the…

Optimization and Control · Mathematics 2016-11-22 Ying Sun , Gesualdo Scutari

We incorporate the conditional value-at-risk (CVaR) quantity into a generalized class of Pickands estimators. By introducing CVaR, the newly developed estimators not only retain the desirable properties of consistency, location, and scale…

Statistics Theory · Mathematics 2024-09-25 Yizhou Li , Pawel Polak

Conditional Value-at-Risk ($\mathrm{CV@R}$) is one of the most popular measures of risk, which has been recently considered as a performance criterion in supervised statistical learning, as it is related to desirable operational features in…

Machine Learning · Computer Science 2021-01-20 Dionysios S. Kalogerias

In this paper, we study the standard formulation of an optimization problem when the computation of gradient is not available. Such a problem can be classified as a "black box" optimization problem, since the oracle returns only the value…

Optimization and Control · Mathematics 2024-09-30 Aleksandr Lobanov , Nail Bashirov , Alexander Gasnikov

This paper addresses a class of general nonsmooth and nonconvex composite optimization problems subject to nonlinear equality constraints. We assume that a part of the objective function and the functional constraints exhibit local…

Optimization and Control · Mathematics 2025-03-04 Lahcen El Bourkhissi , Ion Necoara , Panagiotis Patrinos , Quoc Tran-Dinh

We consider the problem of finding an input to a stochastic black box function such that the scalar output of the black box function is as close as possible to a target value in the sense of the expected squared error. While the…

Machine Learning · Computer Science 2023-05-16 Johannes G. Hoffer , Sascha Ranftl , Bernhard C. Geiger

We propose a distributionally robust index tracking model with the conditional value-at-risk (CVaR) penalty. The model combines the idea of distributionally robust optimization for data uncertainty and the CVaR penalty to avoid large…

Optimization and Control · Mathematics 2023-09-12 Ruyu Wang , Yaozhong Hu , Chao Zhang

This paper deals with sparse feature selection and grouping for classification and regression. The classification or regression problems under consideration consists in minimizing a convex empirical risk function subject to an $\ell^1$…

Statistics Theory · Mathematics 2017-03-27 Michel Barlaud , Wafa Belhajali , Patrick L. Combettes , Lionel Fillatre

Risk averse decision making under uncertainty in partially observable domains is a fundamental problem in AI and essential for reliable autonomous agents. In our case, the problem is modeled using partially observable Markov decision…

Artificial Intelligence · Computer Science 2024-06-11 Yaacov Pariente , Vadim Indelman

In this paper, we introduce an unbiased gradient simulation algorithms for solving convex optimization problem with stochastic function compositions. We show that the unbiased gradient generated from the algorithm has finite variance and…

Optimization and Control · Mathematics 2017-11-22 Jose Blanchet , Donald Goldfarb , Garud Iyengar , Fengpei Li , Chaoxu Zhou

We propose a new approach to portfolio optimization that utilizes a unique combination of synthetic data generation and a CVaR-constraint. We formulate the portfolio optimization problem as an asset allocation problem in which each asset…

Portfolio Management · Quantitative Finance 2024-05-17 José-Manuel Peña , Fernando Suárez , Omar Larré , Domingo Ramírez , Arturo Cifuentes

We consider minimization of a smooth nonconvex function with inexact oracle access to gradient and Hessian (without assuming access to the function value) to achieve approximate second-order optimality. A novel feature of our method is that…

Optimization and Control · Mathematics 2024-03-27 Shuyao Li , Stephen J. Wright

Machine learning (ML) models used in prediction and classification tasks may display performance disparities across population groups determined by sensitive attributes (e.g., race, sex, age). We consider the problem of evaluating the…

Machine Learning · Computer Science 2024-05-28 Lucas Monteiro Paes , Ananda Theertha Suresh , Alex Beutel , Flavio P. Calmon , Ahmad Beirami