中文
相关论文

相关论文: Risk Bounds and Calibration for a Smart Predict-th…

200 篇论文

A new method to estimate the Pareto Front (PF) in bi-objective optimization problems is presented. Assuming a continuous PF, the approach, named ROBBO (RObust and Balanced Bi-objective Optimization), needs to sample at most a finite,…

最优化与控制 · 数学 2025-06-24 Roberto Boffadossi , Marco Leonesio , Lorenzo Fagiano

In multiclass classification over $n$ outcomes, the outcomes must be embedded into the reals with dimension at least $n-1$ in order to design a consistent surrogate loss that leads to the "correct" classification, regardless of the data…

机器学习 · 计算机科学 2026-01-21 Enrique Nueve , Bo Waggoner , Dhamma Kimpara , Jessie Finocchiaro

We study the statistical properties of learning to defer (L2D) to multiple experts. In particular, we address the open problems of deriving a consistent surrogate loss, confidence calibration, and principled ensembling of experts. Firstly,…

机器学习 · 统计学 2023-02-24 Rajeev Verma , Daniel Barrejón , Eric Nalisnick

A new risk bound is presented for the problem of convex/concave function estimation, using the least squares estimator. The best known risk bound, as had appeared in \citet{GSvex}, scaled like $\log(en) n^{-4/5}$ under the mean squared…

统计理论 · 数学 2016-01-11 Sabyasachi Chatterjee

Predict and optimize is an increasingly popular decision-making paradigm that employs machine learning to predict unknown parameters of optimization problems. Instead of minimizing the prediction error of the parameters, it trains…

机器学习 · 计算机科学 2024-02-05 Grigorii Veviurko , Wendelin Böhmer , Mathijs de Weerdt

This paper provides a non-robust interpretation of the distributionally robust optimization (DRO) problem by relating the distributional uncertainties to the chance probabilities. Our analysis allows a decision-maker to interpret the size…

最优化与控制 · 数学 2020-09-22 Qi Wu , Shumin Ma , Cheuk Hang Leung , Wei Liu , Nanbo Peng

Large sectors of the recent optimization literature focused in the last decade on the development of optimal stochastic first order schemes for constrained convex models under progressively relaxed assumptions. Stochastic proximal point is…

最优化与控制 · 数学 2020-05-05 Andrei Patrascu

Many decision processes in artificial intelligence and operations research are modeled by parametric optimization problems whose defining parameters are unknown and must be inferred from observable data. The Predict-Then-Optimize (PtO)…

人工智能 · 计算机科学 2024-02-13 My H Dinh , James Kotary , Ferdinando Fioretto

Solving optimization problems with unknown parameters often requires learning a predictive model to predict the values of the unknown parameters and then solving the problem using these values. Recent work has shown that including the…

机器学习 · 计算机科学 2020-10-23 Kai Wang , Bryan Wilder , Andrew Perrault , Milind Tambe

This study focuses on solving group zero-norm regularized robust loss minimization problems. We propose a proximal Majorization-Minimization (PMM) algorithm to address a class of equivalent Difference-of-Convex (DC) surrogate optimization…

最优化与控制 · 数学 2025-05-30 Ling Liang , Shujun Bi

Robust optimization is a popular paradigm for modeling and solving two- and multi-stage decision-making problems affected by uncertainty. In many real-world applications, the time of information discovery is decision-dependent and the…

最优化与控制 · 数学 2022-08-24 Phebe Vayanos , Angelos Georghiou , Han Yu

Decision support systems often rely on solving complex optimization problems that may require to estimate uncertain parameters beforehand. Recent studies have shown how using traditionally trained estimators for this task can lead to…

机器学习 · 计算机科学 2025-12-19 Gaetano Signorelli , Michele Lombardi

Intuitively, a more deterministic time series should be easier to forecast. However, point-wise loss functions (e.g., MSE and MAE), serving as differentiable surrogates for the ideal optimization target, score each timestamp independently…

机器学习 · 计算机科学 2026-05-12 Rongyao Cai , Yuxi Wan , Kexin Zhang , Ming Jin , Zhiqiang Ge , Daoyi Dong , Hang Yu , Yong Liu , Qingsong Wen

Empirical risk minimization frequently employs convex surrogates to underlying discrete loss functions in order to achieve computational tractability during optimization. However, classical convex surrogates can only tightly bound modular…

机器学习 · 统计学 2016-04-13 Jiaqian Yu , Matthew Blaschko

While Group Relative Policy Optimization (GRPO) has emerged as a scalable framework for critic-free policy learning, extending it to settings with explicit behavioral constraints remains underexplored. We introduce Constrained GRPO, a…

机器学习 · 计算机科学 2026-02-09 Roger Girgis , Rodrigue de Schaetzen , Luke Rowe , Azalée Robitaille , Christopher Pal , Liam Paull

We study differentially private (DP) algorithms for stochastic convex optimization: the problem of minimizing the population loss given i.i.d. samples from a distribution over convex loss functions. A recent work of Bassily et al. (2019)…

机器学习 · 计算机科学 2020-05-12 Vitaly Feldman , Tomer Koren , Kunal Talwar

In many operational settings, decision-makers must commit to actions before uncertainty resolves, but existing optimization tools rarely quantify how consistently a chosen decision remains optimal across plausible scenarios. This paper…

机器学习 · 统计学 2025-12-18 Wenbin Zhou , Agni Orfanoudaki , Shixiang Zhu

A framework previously introduced in [3] for solving a sequence of stochastic optimization problems with bounded changes in the minimizers is extended and applied to machine learning problems such as regression and classification. The…

机器学习 · 计算机科学 2019-04-08 Craig Wilson , Yuheng Bu , Venugopal Veeravalli

We develop methods for nonparametric uniform inference in cost-sensitive binary classification, a framework that encompasses maximum score estimation, predicting utility maximizing actions, and policy learning. These problems are well known…

计量经济学 · 经济学 2025-12-16 Nan Liu , Yanbo Liu , Yuya Sasaki , Yuanyuan Wan

Stochastic compositional optimization (SCO) has attracted considerable attention because of its broad applicability to important real-world problems. However, existing works on SCO assume that the projection within a solution update is…

最优化与控制 · 数学 2025-05-27 Shuoguang Yang , Wei You , Zhe Zhang , Ethan X. Fang