English
Related papers

Related papers: Achievable distributional robustness when the robu…

200 papers

This thesis investigates three areas targeted at improving the reliability of machine learning; fairness in machine learning, strategic classification, and algorithmic robustness. Each of these domains has special properties or structure…

Machine Learning · Computer Science 2024-08-30 Kevin Stangl

Despite remarkable achievements in deep learning across various domains, its inherent vulnerability to adversarial examples still remains a critical concern for practical deployment. Adversarial training has emerged as one of the most…

Machine Learning · Computer Science 2024-11-06 Junhao Dong , Xinghua Qu , Z. Jane Wang , Yew-Soon Ong

Decision making and learning in the presence of uncertainty has attracted significant attention in view of the increasing need to achieve robust and reliable operations. In the case where uncertainty stems from the presence of adversarial…

Machine Learning · Computer Science 2024-03-25 André Bertolace , Konstatinos Gatsis , Kostas Margellos

Well-known for its simplicity and effectiveness in classification, AdaBoost, however, suffers from overfitting when class-conditional distributions have significant overlap. Moreover, it is very sensitive to noise that appears in the…

Machine Learning · Statistics 2018-06-22 Zhi Xiao , Zhe Luo , Bo Zhong , Xin Dang

Conditional probabilities are a core concept in machine learning. For example, optimal prediction of a label $Y$ given an input $X$ corresponds to maximizing the conditional probability of $Y$ given $X$. A common approach to inference tasks…

Machine Learning · Computer Science 2017-08-09 Yoav Wald , Amir Globerson

Current deep learning solutions are well known for not informing whether they can reliably classify an example during inference. One of the most effective ways to build more reliable deep learning solutions is to improve their performance…

Machine Learning · Computer Science 2022-08-09 David Macêdo

In this paper, we focus on a data-driven risk-averse multistage stochastic programming (RMSP) model considering distributional robustness. We optimize the RMSP over the worst-case distribution within an ambiguity set of probability…

Optimization and Control · Mathematics 2017-08-29 Jianqiu Huang , Kezhuo Zhou , Yongpei Guan

Robust optimization (RO) is a common approach to tractably obtain safeguarding solutions for optimization problems with uncertain constraints. In this paper, we study a statistical framework to integrate data into RO, based on learning a…

Optimization and Control · Mathematics 2020-03-03 L. Jeff Hong , Zhiyuan Huang , Henry Lam

We study statistical inference and distributionally robust solution methods for stochastic optimization problems, focusing on confidence intervals for optimal values and solutions that achieve exact coverage asymptotically. We develop a…

Machine Learning · Statistics 2018-07-03 John Duchi , Peter Glynn , Hongseok Namkoong

Algorithmic robust statistics has traditionally focused on the contamination model where a small fraction of the samples are arbitrarily corrupted. We consider a recent contamination model that combines two kinds of corruptions: (i) small…

Data Structures and Algorithms · Computer Science 2024-10-23 Thanasis Pittas , Ankit Pensia

Batch policy optimization considers leveraging existing data for policy construction before interacting with an environment. Although interest in this problem has grown significantly in recent years, its theoretical foundations remain…

Machine Learning · Computer Science 2021-04-07 Chenjun Xiao , Yifan Wu , Tor Lattimore , Bo Dai , Jincheng Mei , Lihong Li , Csaba Szepesvari , Dale Schuurmans

Managing insurance and financial risk when data is limited is a key task in the insurance industry. In this paper, we focus on cases where the risk distribution is modeled as a mixture with some components estimable to high precision or…

Optimization and Control · Mathematics 2026-03-03 N. D. Shyamalkumar , Tianrun Wang

Providing generalization guarantees for stochastic optimization algorithms remains a key challenge in learning theory. Recently, numerous works demonstrated the impact of the geometric properties of optimization trajectories on…

Machine Learning · Computer Science 2026-01-23 Mario Tuci , Lennart Bastian , Benjamin Dupuis , Nassir Navab , Tolga Birdal , Umut Şimşekli

This paper proposes risk-averse and risk-agnostic formulations to robust design in which solutions that satisfy the system requirements for a set of scenarios are pursued. These scenarios, which correspond to realizations of uncertain…

Optimization and Control · Mathematics 2025-11-07 Luis G. Crespo , Bret Stanford , Natalia Alexandrov

Causal discovery aims to learn causal relationships between variables from targeted data, making it a fundamental task in machine learning. However, causal discovery algorithms often rely on unverifiable causal assumptions, which are…

Machine Learning · Computer Science 2025-10-15 Huiyang Yi , Yanyan He , Duxin Chen , Mingyu Kang , He Wang , Wenwu Yu

We propose a new algorithm for the solution of the robust multiple-load topology optimization problem. The algorithm can be applied to any type of problem, e.g., truss topology, variable thickness sheet or free material optimization. We…

Optimization and Control · Mathematics 2013-07-30 Michal Kocvara

In deep learning applications, robustness measures the ability of neural models that handle slight changes in input data, which could lead to potential safety hazards, especially in safety-critical applications. Pre-deployment assessment of…

Software Engineering · Computer Science 2024-04-26 Wenchuan Mu , Kwan Hui Lim

Robustness is pivotal for comprehending, designing, optimizing, and rehabilitating networks, with simulation attacks being the prevailing evaluation method. Simulation attacks are often time-consuming or even impractical, however, a more…

Social and Information Networks · Computer Science 2024-03-04 Wenjun Jiang , Peiyan Li , Tianlong Fan , Ting Li , Chuan-fu Zhang , Tao Zhang , Zong-fu Luo

In safety-critical deep learning applications, robustness measures the ability of neural models that handle imperceptible perturbations in input data, which may lead to potential safety hazards. Existing pre-deployment robustness assessment…

Machine Learning · Computer Science 2025-08-27 Wenchuan Mu , Kwan Hui Lim

We propose and analyze algorithms for distributionally robust optimization of convex losses with conditional value at risk (CVaR) and $\chi^2$ divergence uncertainty sets. We prove that our algorithms require a number of gradient…

Optimization and Control · Mathematics 2020-12-14 Daniel Levy , Yair Carmon , John C. Duchi , Aaron Sidford