English
Related papers

Related papers: Risk Guarantees for End-to-End Prediction and Opti…

200 papers

When dealing with right-censored data, where some outcomes are missing due to a limited observation period, survival analysis -- known as time-to-event analysis -- focuses on predicting the time until an event of interest occurs. Multiple…

Machine Learning · Statistics 2024-10-23 Julie Alberge , Vincent Maladière , Olivier Grisel , Judith Abécassis , Gaël Varoquaux

Prediction becomes more challenging with missing covariates. What method is chosen to handle missingness can greatly affect how models perform. In many real-world problems, the best prediction performance is achieved by models that can…

As large-scale training regimes have gained popularity, the use of pretrained models for downstream tasks has become common practice in machine learning. While pretraining has been shown to enhance the performance of models in practice, the…

Machine Learning · Computer Science 2023-10-10 Laura Fee Nern , Harsh Raj , Maurice Georgi , Yash Sharma

Missing values are prevalent across various fields, posing challenges for training and deploying predictive models. In this context, imputation is a common practice, driven by the hope that accurate imputations will enhance predictions.…

Artificial Intelligence · Computer Science 2025-02-21 Marine Le Morvan , Gaël Varoquaux

Many decision-making processes involve solving a combinatorial optimization problem with uncertain input that can be estimated from historic data. Recently, problems in this class have been successfully addressed via end-to-end learning…

Machine Learning · Computer Science 2021-07-07 Maxime Mulamba , Jayanta Mandi , Michelangelo Diligenti , Michele Lombardi , Victor Bucarey , Tias Guns

Predicting future outcomes is a prevalent application of machine learning in social impact domains. Examples range from predicting student success in education to predicting disease risk in healthcare. Practitioners recognize that the…

Machine Learning · Computer Science 2023-09-11 Lydia T. Liu , Solon Barocas , Jon Kleinberg , Karen Levy

We study the continuity properties of optimal solutions to stochastic control problems with respect to initial probability measures and applications of these to the robustness of optimal control policies applied to systems with incomplete…

Systems and Control · Computer Science 2019-04-16 Ali Devran Kara , Serdar Yüksel

A common problem in the optimization of structures is the handling of uncertainties in the parameters. If the parameters appear in the constraints, the uncertainties can lead to an infinite number of constraints. Usually the constraints…

Optimization and Control · Mathematics 2012-05-01 Daniel P. Mohr , Ina Stein , Thomas Matzies , Christina A. Knapek

We study sequential prediction of real-valued, arbitrary and unknown sequences under the squared error loss as well as the best parametric predictor out of a large, continuous class of predictors. Inspired by recent results from…

Machine Learning · Computer Science 2014-01-24 N. Denizcan Vanli , Suleyman S. Kozat

We propose and analyze a novel theoretical and algorithmic framework for structured prediction. While so far the term has referred to discrete output spaces, here we consider more general settings, such as manifolds or spaces of probability…

Machine Learning · Statistics 2020-02-14 Carlo Ciliberto , Lorenzo Rosasco , Alessandro Rudi

Given a prediction task, understanding when one can and cannot design a consistent convex surrogate loss, particularly a low-dimensional one, is an important and active area of machine learning research. The prediction task may be given as…

Machine Learning · Computer Science 2021-02-17 Jessie Finocchiaro , Rafael Frongillo , Bo Waggoner

With the increasing pace of automation, modern robotic systems need to act in stochastic, non-stationary, partially observable environments. A range of algorithms for finding parameterized policies that optimize for long-term average…

Machine Learning · Computer Science 2019-09-04 David Nass , Boris Belousov , Jan Peters

Defect prediction models---classifiers that identify defect-prone software modules---have configurable parameters that control their characteristics (e.g., the number of trees in a random forest). Recent studies show that these classifiers…

Software Engineering · Computer Science 2018-02-01 Chakkrit Tantithamthavorn , Shane McIntosh , Ahmed E. Hassan , Kenichi Matsumoto

Learning to optimize is an approach that leverages training data to accelerate the solution of optimization problems. Many approaches use unrolling to parametrize the update step and learn optimal parameters. Although L2O has shown…

Optimization and Control · Mathematics 2025-07-15 Patrick Fahy , Mohammad Golbabaee , Matthias J. Ehrhardt

Stochastic optimization problems often involve the expectation in its objective. When risk is incorporated in the problem description as well, then risk measures have to be involved in addition to quantify the acceptable risk, often in the…

Statistics Theory · Mathematics 2012-09-18 Alois Pichler

Pre-training has achieved remarkable success when transferred to downstream tasks. In machine learning, we care about not only the good performance of a model but also its behavior under reasonable shifts of condition. The same philosophy…

Computer Vision and Pattern Recognition · Computer Science 2023-11-27 Jianghui Wang , Yang Chen , Xingyu Xie , Cong Fang , Zhouchen Lin

Control algorithms such as model predictive control (MPC) and state estimators rely on a number of different parameters. The performance of the closed loop usually depends on the correct setting of these parameters. Tuning is often done…

Systems and Control · Electrical Eng. & Systems 2020-10-15 David Stenger , Muzaffer Ay , Dirk Abel

It is well known that accurate probabilistic predictors can be trained through empirical risk minimisation with proper scoring rules as loss functions. While such learners capture so-called aleatoric uncertainty of predictions, various…

Machine Learning · Computer Science 2023-01-31 Viktor Bengs , Eyke Hüllermeier , Willem Waegeman

Optimization problems in engineering and applied mathematics are typically solved in an iterative fashion, by systematically adjusting the variables of interest until an adequate solution is found. The iterative algorithms that govern these…

Optimization and Control · Mathematics 2022-05-31 Laurent Lessard

We propose a novel distribution-free scheme to solve optimization problems where the goal is to minimize the expected value of a cost function subject to probabilistic constraints. Unlike standard sampling-based methods, our idea consists…

Optimization and Control · Mathematics 2025-05-28 Francesco Cordiano , Matin Jafarian , Bart De Schutter