English
Related papers

Related papers: Contextual Optimization under Covariate Shift: A R…

200 papers

The Halpern iteration for solving monotone inclusion problems has gained increasing interests in recent years due to its simple form and appealing convergence properties. In this paper, we investigate the inexact variants of the scheme in…

Optimization and Control · Mathematics 2025-05-28 Ling Liang , Zusen Xu , Kim-Chuan Toh , Jia-Jie Zhu

Training machine learning models robust to distribution shifts is critical for real-world applications. Some robust training algorithms (e.g., Group DRO) specialize to group shifts and require group information on all training points. Other…

Machine Learning · Computer Science 2023-10-13 Amrith Setlur , Don Dennis , Benjamin Eysenbach , Aditi Raghunathan , Chelsea Finn , Virginia Smith , Sergey Levine

In many operational settings, decision-makers must commit to actions before uncertainty resolves, but existing optimization tools rarely quantify how consistently a chosen decision remains optimal across plausible scenarios. This paper…

Machine Learning · Statistics 2025-12-18 Wenbin Zhou , Agni Orfanoudaki , Shixiang Zhu

We consider learning in an adversarial environment, where an $\varepsilon$-fraction of samples from a distribution $P$ are arbitrarily modified (global corruptions) and the remaining perturbations have average magnitude bounded by $\rho$…

Machine Learning · Computer Science 2024-06-26 Sloan Nietert , Ziv Goldfeld , Soroosh Shafiee

Neural networks make accurate predictions but often fail to provide reliable uncertainty estimates, especially under covariate distribution shifts between training and testing. To address this problem, we propose a Bayesian framework for…

Machine Learning · Statistics 2025-12-22 Yuli Slavutsky , David M. Blei

We consider the problem of distributionally robust multimodal machine learning. Existing approaches often rely on merging modalities on the feature level (early fusion) or heuristic uncertainty modeling, which downplays modality-aware…

Machine Learning · Computer Science 2025-11-11 Peilin Yang , Yu Ma

Robust optimization is a tractable and expressive technique for decision-making under uncertainty, but it can lead to overly conservative decisions when pessimistic assumptions are made on the uncertain parameters. Wasserstein…

Optimization and Control · Mathematics 2026-04-07 Irina Wang , Cole Becker , Bart Van Parys , Bartolomeo Stellato

Inverse problems in physical or biological sciences often involve recovering an unknown parameter that is random. The sought-after quantity is a probability distribution of the unknown parameter, that produces data that aligns with…

Machine Learning · Statistics 2024-10-02 Qin Li , Maria Oprea , Li Wang , Yunan Yang

Distributionally Robust Optimization (DRO), as a popular method to train robust models against distribution shift between training and test sets, has received tremendous attention in recent years. In this paper, we propose and analyze…

Machine Learning · Computer Science 2023-08-17 Qi Qi , Jiameng Lyu , Kung sik Chan , Er Wei Bai , Tianbao Yang

This study addresses a class of linear mixed-integer programming (MILP) problems that involve uncertainty in the objective function parameters. The parameters are assumed to form a random vector, whose probability distribution can only be…

Optimization and Control · Mathematics 2024-03-07 Sergey S. Ketkov

Reinforcement learning algorithms, though successful, tend to over-fit to training environments hampering their application to the real-world. This paper proposes $\text{W}\text{R}^{2}\text{L}$ -- a robust reinforcement learning algorithm…

Machine Learning · Computer Science 2019-09-18 Mohammed Amin Abdullah , Hang Ren , Haitham Bou Ammar , Vladimir Milenkovic , Rui Luo , Mingtian Zhang , Jun Wang

Score-based diffusion models currently constitute the state of the art in continuous generative modeling. These methods are typically formulated via overdamped or underdamped Ornstein--Uhlenbeck-type stochastic differential equations, in…

Machine Learning · Computer Science 2025-12-22 Herlock Rahimi

Offline reinforcement learning aims to learn from pre-collected datasets without active exploration. This problem faces significant challenges, including limited data availability and distributional shifts. Existing approaches adopt a…

Machine Learning · Computer Science 2024-10-01 Yue Wang , Jinjun Xiong , Shaofeng Zou

We introduce contextual stochastic bilevel optimization (CSBO) -- a stochastic bilevel optimization framework with the lower-level problem minimizing an expectation conditioned on some contextual information and the upper-level decision…

Optimization and Control · Mathematics 2023-10-31 Yifan Hu , Jie Wang , Yao Xie , Andreas Krause , Daniel Kuhn

Intensively studied in theory as a promising data-driven tool for decision-making under ambiguity, two-stage distributionally robust optimization (DRO) problems over Wasserstein balls are not necessarily easy to solve in practice. This is…

Optimization and Control · Mathematics 2023-01-03 Youngchae Cho , Insoon Yang

Multi-objective optimization (MOO) aims to optimize multiple, possibly conflicting objectives with widespread applications. We introduce a novel interacting particle method for MOO inspired by molecular dynamics simulations. Our approach…

Machine Learning · Computer Science 2024-11-22 Yinuo Ren , Tesi Xiao , Tanmay Gangwani , Anshuka Rangi , Holakou Rahmanian , Lexing Ying , Subhajit Sanyal

We review distributionally robust optimization (DRO), a principled approach for constructing statistical estimators that hedge against the impact of deviations in the expected loss between the training and deployment environments. Many…

Methodology · Statistics 2024-01-29 Jose Blanchet , Jiajin Li , Sirui Lin , Xuhui Zhang

Wasserstein gradient flow has emerged as a promising approach to solve optimization problems over the space of probability distributions. A recent trend is to use the well-known JKO scheme in combination with input convex neural networks to…

Machine Learning · Computer Science 2022-07-26 Jiaojiao Fan , Qinsheng Zhang , Amirhossein Taghvaei , Yongxin Chen

Shape-constrained optimization arises in a wide range of problems including distributionally robust optimization (DRO) that has surging popularity in recent years. In the DRO literature, these problems are usually solved via reduction into…

Optimization and Control · Mathematics 2024-06-13 Henry Lam , Zhenyuan Liu , Dashi I. Singham

Identifying the causal relationship among variables from observational data is an important yet challenging task. This work focuses on identifying the direct causes of an outcome and estimating their magnitude, i.e., learning the causal…

Methodology · Statistics 2026-01-08 Zhenyu Wang , Yifan Hu , Peter Bühlmann , Zijian Guo
‹ Prev 1 8 9 10 Next ›