English
Related papers

Related papers: Robust Probability Updating

200 papers

We tackle the problem of conditioning probabilistic programs on distributions of observable variables. Probabilistic programs are usually conditioned on samples from the joint data distribution, which we refer to as deterministic…

Machine Learning · Computer Science 2021-03-09 David Tolpin , Yuan Zhou , Tom Rainforth , Hongseok Yang

Inspired by regularization techniques in statistics and machine learning, we study complementary composite minimization in the stochastic setting. This problem corresponds to the minimization of the sum of a (weakly) smooth function endowed…

Machine Learning · Computer Science 2024-01-24 Alexandre d'Aspremont , Cristóbal Guzmán , Clément Lezane

In this paper, we discuss optimality conditions for optimization problems involving random state constraints, which are modeled in probabilistic or almost sure form. While the latter can be understood as the limiting case of the former, the…

Optimization and Control · Mathematics 2024-01-17 Caroline Geiersbach , René Henrion

Extracting maximal information from experimental data requires access to the likelihood function, which however is never directly available for complex experiments like those performed at high energy colliders. Theoretical predictions are…

High Energy Physics - Phenomenology · Physics 2023-08-11 Siyu Chen , Alfredo Glioti , Giuliano Panico , Andrea Wulzer

Hierarchical time series are common in several applied fields. The forecasts for these time series are required to be coherent, that is, to satisfy the constraints given by the hierarchy. The most popular technique to enforce coherence is…

Machine Learning · Statistics 2023-10-13 Lorenzo Zambon , Dario Azzimonti , Giorgio Corani

We consider the stochastic gradient method with random reshuffling ($\mathsf{RR}$) for tackling smooth nonconvex optimization problems. $\mathsf{RR}$ finds broad applications in practice, notably in training neural networks. In this work,…

Optimization and Control · Mathematics 2026-04-17 Hengxu Yu , Xiao Li

Deep learning requires regularization mechanisms to reduce overfitting and improve generalization. We address this problem by a new regularization method based on distributional robust optimization. The key idea is to modify the…

Machine Learning · Computer Science 2020-06-08 Aurora Cobo Aguilera , Antonio Artés-Rodríguez , Fernando Pérez-Cruz , Pablo Martínez Olmos

In clinical prediction modeling, model updating refers to the practice of modifying a prediction model before it is used in a new setting. In the context of logistic regression for a binary outcome, one of the simplest updating methods is a…

Applications · Statistics 2022-04-12 Mohsen Sadatsafavi , Hamid Tavakoli , Abdollah Safari

Inverse classification, the process of making meaningful perturbations to a test point such that it is more likely to have a desired classification, has previously been addressed using data from a single static point in time. Such an…

Machine Learning · Computer Science 2016-11-15 Michael T. Lash , W. Nick Street

We propose a data-driven portfolio selection model that integrates side information, conditional estimation and robustness using the framework of distributionally robust optimization. Conditioning on the observed side information, the…

Portfolio Management · Quantitative Finance 2024-04-10 Viet Anh Nguyen , Fan Zhang , Shanshan Wang , Jose Blanchet , Erick Delage , Yinyu Ye

Many problems in Reinforcement Learning (RL) seek an optimal policy with large discrete multidimensional yet unordered action spaces; these include problems in randomized allocation of resources such as placements of multiple security…

Machine Learning · Computer Science 2023-11-28 Changyu Chen , Ramesha Karunasena , Thanh Hong Nguyen , Arunesh Sinha , Pradeep Varakantham

This paper studies the problem of distributionally robust model predictive control (MPC) using total variation distance ambiguity sets. For a discrete-time linear system with additive disturbances, we provide a conditional value-at-risk…

Systems and Control · Electrical Eng. & Systems 2022-06-27 Anushri Dixit , Mohamadreza Ahmadi , Joel W. Burdick

In recent years a popular nonparametric model for coarsened data is an assumption on the coarsening mechanism called coarsening at random (CAR). It has been conjectured in several papers that this assumption cannot be tested by the data,…

Statistics Theory · Mathematics 2007-06-13 Eric A. Cator

Probabilistic Regression refers to predicting a full probability density function for the target conditional on the features. We present a nonparametric approach to this problem which combines base classifiers (typically gradient boosted…

Machine Learning · Computer Science 2022-10-31 Brian Lucena

An approach to reasoning with default rules where the proportion of exceptions, or more generally the probability of encountering an exception, can be at least roughly assessed is presented. It is based on local uncertainty propagation…

Artificial Intelligence · Computer Science 2013-03-26 Stephane Amarger , Didier Dubois , Henri Prade

In high-stakes engineering applications, optimization algorithms must come with provable worst-case guarantees over a mathematically defined class of problems. Designing for the worst case, however, inevitably sacrifices performance on the…

Systems and Control · Electrical Eng. & Systems 2025-08-04 Andrea Martin , Ian R. Manchester , Luca Furieri

Regularization is a central tool for addressing ill-posedness in inverse problems and statistical estimation, with the choice of a suitable penalty often determining the reliability and interpretability of downstream solutions. While recent…

Optimization and Control · Mathematics 2025-10-07 Oscar Leong , Eliza O'Reilly , Yong Sheng Soh

Chance constrained program where one seeks to minimize an objective over decisions which satisfy randomly disturbed constraints with a given probability is computationally intractable. This paper proposes an approximate approach to address…

Computation · Statistics 2019-12-23 Xun Shen , Jiancang Zhuang , Xingguo Zhang

The field of Contextual Optimization (CO) integrates machine learning and optimization to solve decision making problems under uncertainty. Recently, a risk sensitive variant of CO, known as Conditional Robust Optimization (CRO), combines…

Machine Learning · Computer Science 2024-03-08 Abhilash Chenreddy , Erick Delage

Constrained quantization for a Borel probability measure refers to the idea of estimating a given probability by a discrete probability with a finite number of supporting points lying on a specific set. The specific set is known as the…