English
Related papers

Related papers: Empirical risk minimization is optimal for the con…

200 papers

We consider the question of estimating a solution to a system of equations that involve convex nonlinearities, a problem that is common in machine learning and signal processing. Because of these nonlinearities, conventional estimators…

Machine Learning · Computer Science 2018-08-14 Sohail Bahmani , Justin Romberg

We present an exact algorithm for mean-risk optimization subject to a budget constraint, where decision variables may be continuous or integer. The risk is measured by the covariance matrix and weighted by an arbitrary monotone function,…

Optimization and Control · Mathematics 2017-05-08 Christoph Buchheim , Marianna De Santis , Francesco Rinaldi , Long Trieu

A subgradient method is presented for solving general convex optimization problems, the main requirement being that a strictly-feasible point is known. A feasible sequence of iterates is generated, which converges to within user-specified…

Optimization and Control · Mathematics 2016-05-30 James Renegar

In this work we develop a new algorithm for regularized empirical risk minimization. Our method extends recent techniques of Shalev-Shwartz [02/2015], which enable a dual-free analysis of SDCA, to arbitrary mini-batching schemes. Moreover,…

Optimization and Control · Mathematics 2015-06-09 Dominik Csiba , Peter Richtárik

The sparse portfolio selection problem is one of the most famous and frequently-studied problems in the optimization and financial economics literatures. In a universe of risky assets, the goal is to construct a portfolio with maximal…

Optimization and Control · Mathematics 2022-02-22 Dimitris Bertsimas , Ryan Cory-Wright

In regularized risk minimization, the associated optimization problem becomes particularly difficult when both the loss and regularizer are nonsmooth. Existing approaches either have slow or unclear convergence properties, are restricted to…

Machine Learning · Computer Science 2016-10-14 Shuai Zheng , Ruiliang Zhang , James T. Kwok

This paper studies empirical risk minimization (ERM) problems for large-scale datasets and incorporates the idea of adaptive sample size methods to improve the guaranteed convergence bounds for first-order stochastic and deterministic…

Machine Learning · Computer Science 2017-09-05 Aryan Mokhtari , Alejandro Ribeiro

We propose a novel class of convex risk measures, based on the concept of the Fr\'echet mean, designed in order to handle uncertainty which arises from multiple information sources regarding the risk factors of interest. The proposed risk…

Risk Management · Quantitative Finance 2022-09-13 Georgios I. Papayiannis , Athanasios N. Yannacopoulos

The de-facto standard approach of promoting sparsity by means of $\ell_1$-regularization becomes ineffective in the presence of simplex constraints, i.e.,~the target is known to have non-negative entries summing up to a given constant. The…

Methodology · Statistics 2016-05-04 Ping Li , Syama Sundar Rangapuram , Martin Slawski

Given a strictly convex multiobjective optimization problem with objective functions $f_1,\dots,f_N$, let us denote by $x_0$ its solution, obtained as minimum point of the linear scalarized problem, where the objective function is the…

Optimization and Control · Mathematics 2023-03-06 Carlo Alberto De Bernardi , Enrico Miglierina , Elena Molho , Jacopo Somaglia

This paper proposes a novel non-parametric multidimensional convex regression estimator which is designed to be robust to adversarial perturbations in the empirical measure. We minimize over convex functions the maximum (over Wasserstein…

Statistics Theory · Mathematics 2020-07-28 Jose Blanchet , Peter W. Glynn , Jun Yan , Zhengqing Zhou

As most robust combinatorial min-max and min-max regret problems with discrete uncertainty sets are NP-hard, research into approximation algorithm and approximability bounds has been a fruitful area of recent work. A simple and well-known…

Data Structures and Algorithms · Computer Science 2016-11-30 Marc Goerigk , André Chassein

Minimizing a convex function over the spectrahedron, i.e., the set of all positive semidefinite matrices with unit trace, is an important optimization task with many applications in optimization, machine learning, and signal processing. It…

Optimization and Control · Mathematics 2016-05-23 Dan Garber

We investigate the ergodic problem of growth-rate maximization under a class of risk constraints in the context of incomplete, It\^{o}-process models of financial markets with random ergodic coefficients. Including {\em value-at-risk}…

Portfolio Management · Quantitative Finance 2008-12-02 Traian A. Pirvu , Gordan Zitkovic

This paper considers a risk-constrained infinite-horizon optimal control problem and proposes to solve it in an iterative manner. Each iteration of the algorithm generates a trajectory from the starting point to the target equilibrium state…

Optimization and Control · Mathematics 2021-11-29 Alireza Zolanvari , Ashish Cherukuri

We consider the classic Kelly gambling problem with general distribution of outcomes, and an additional risk constraint that limits the probability of a drawdown of wealth to a given undesirable level. We develop a bound on the drawdown…

Portfolio Management · Quantitative Finance 2016-03-22 Enzo Busseti , Ernest K. Ryu , Stephen Boyd

In this paper, we initiate a systematic investigation of differentially private algorithms for convex empirical risk minimization. Various instantiations of this problem have been studied before. We provide new algorithms and matching lower…

Machine Learning · Computer Science 2014-10-21 Raef Bassily , Adam Smith , Abhradeep Thakurta

We obtain sharp oracle inequalities for the empirical risk minimization procedure in the regression model under the assumption that the target Y and the model F are subgaussian. The bound we obtain is sharp in the minimax sense if F is…

Statistics Theory · Mathematics 2016-09-20 Guillaume Lecué , Shahar Mendelson

${\rm CoVaR}$ is one of the most important measures of financial systemic risks. It is defined as the risk of a financial portfolio conditional on another financial portfolio being at risk. In this paper we first develop a Monte-Carlo…

Risk Management · Quantitative Finance 2022-10-13 Weihuan Huang , Nifei Lin , L. Jeff Hong

This paper presents a practical method for finding the globally optimal solution to the sum-of-ratios problem arising in image processing, engineering and management. Unlike traditional methods which may get trapped in local minima due to…

Optimization and Control · Mathematics 2012-08-07 Yunchol Jong