English
Related papers

Related papers: Robust Generalization against Photon-Limited Corru…

200 papers

This paper introduces Inverse Distributionally Robust Optimization (I-DRO) as a method to infer the conservativeness level of a decision-maker, represented by the size of a Wasserstein metric-based ambiguity set, from the optimal decisions…

Optimization and Control · Mathematics 2024-05-07 Qi Li , Zhirui Liang , Andrey Bernstein , Yury Dvorkin

We propose a general approach for training survival analysis models that minimizes a worst-case error across all subpopulations that are large enough (occurring with at least a user-specified minimum probability). This approach uses a…

Machine Learning · Statistics 2022-11-22 Shu Hu , George H. Chen

We argue that the vulnerability of model parameters is of crucial value to the study of model robustness and generalization but little research has been devoted to understanding this matter. In this work, we propose an indicator to measure…

Machine Learning · Computer Science 2020-12-11 Xu Sun , Zhiyuan Zhang , Xuancheng Ren , Ruixuan Luo , Liangyou Li

A novel distributed algorithm is proposed for finite-time converging to a feasible consensus solution satisfying global optimality to a certain accuracy of the distributed robust convex optimization problem (DRCO) subject to bounded…

Optimization and Control · Mathematics 2023-09-06 Xunhao Wu , Jun Fu

The performance of graph representation learning is affected by the quality of graph input. While existing research usually pursues a globally smoothed graph embedding, we believe the rarely observed anomalies are as well harmful to an…

Machine Learning · Computer Science 2023-08-14 Bingxin Zhou , Yuanhong Jiang , Yu Guang Wang , Jingwei Liang , Junbin Gao , Shirui Pan , Xiaoqun Zhang

Training models that perform well under distribution shifts is a central challenge in machine learning. In this paper, we introduce a modeling framework where, in addition to training data, we have partial structural knowledge of the…

Machine Learning · Computer Science 2021-10-28 Tobias Sutter , Andreas Krause , Daniel Kuhn

Distributionally Robust Optimization (DRO), as a popular method to train robust models against distribution shift between training and test sets, has received tremendous attention in recent years. In this paper, we propose and analyze…

Machine Learning · Computer Science 2023-08-17 Qi Qi , Jiameng Lyu , Kung sik Chan , Er Wei Bai , Tianbao Yang

Achieving robustness to distributional shift is a longstanding and challenging goal of computer vision. Data augmentation is a commonly used approach for improving robustness, however robustness gains are typically not uniform across…

Machine Learning · Computer Science 2020-09-18 Dong Yin , Raphael Gontijo Lopes , Jonathon Shlens , Ekin D. Cubuk , Justin Gilmer

Tomography inference attacks aim to reconstruct network topology by analyzing end-to-end probe delays. Existing defenses mitigate these attacks by manipulating probe delays to mislead inference, but rely on two strong assumptions: (i) probe…

Networking and Internet Architecture · Computer Science 2025-08-19 Chengze Du , Heng Xu , Zhiwei Yu , Ying Zhou , Zili Meng , Jialong Li

Invariance to a broad array of image corruptions, such as warping, noise, or color shifts, is an important aspect of building robust models in computer vision. Recently, several new data augmentations have been proposed that significantly…

Computer Vision and Pattern Recognition · Computer Science 2021-11-22 Eric Mintun , Alexander Kirillov , Saining Xie

A data analyst might worry about generalization if dropping a very small fraction of data points from a study could change its substantive conclusions. Checking this non-robustness directly poses a combinatorial optimization problem and is…

Methodology · Statistics 2025-09-10 Jenny Y. Huang , David R. Burt , Yunyi Shen , Tin D. Nguyen , Tamara Broderick

Neural networks have demonstrated significant accuracy across various domains, yet their vulnerability to subtle input alterations remains a persistent challenge. Conventional methods like data augmentation, while effective to some extent,…

Machine Learning · Computer Science 2023-11-20 Shashank Kotyan , Danilo Vasconcellos Vargas

We present a computationally efficient framework, called $\texttt{FlowDRO}$, for solving flow-based distributionally robust optimization (DRO) problems with Wasserstein uncertainty sets while aiming to find continuous worst-case…

Machine Learning · Computer Science 2024-02-27 Chen Xu , Jonghyeok Lee , Xiuyuan Cheng , Yao Xie

In this paper, we study the generalization properties of neural networks under input perturbations and show that minimal training data corruption by a few pixel modifications can cause drastic overfitting. We propose an evolutionary…

Machine Learning · Computer Science 2020-03-17 Subhajit Chaudhury , Toshihiko Yamasaki

Diffusion Probabilistic Models (DPMs) have achieved significant success in generative tasks. However, their training and sampling processes suffer from the issue of distribution mismatch. During the denoising process, the input data…

Machine Learning · Computer Science 2025-02-25 Zekun Wang , Mingyang Yi , Shuchen Xue , Zhenguo Li , Ming Liu , Bing Qin , Zhi-Ming Ma

Off-policy evaluation and learning are concerned with assessing a given policy and learning an optimal policy from offline data without direct interaction with the environment. Often, the environment in which the data are collected differs…

Machine Learning · Computer Science 2024-01-18 Yi Shen , Pan Xu , Michael M. Zavlanos

Invariant risk minimization (IRM) aims to enable out-of-distribution (OOD) generalization in deep learning by learning invariant representations. As IRM poses an inherently challenging bi-level optimization problem, most existing approaches…

Machine Learning · Computer Science 2025-05-26 Kotaro Yoshida , Konstantinos Slavakis

We consider a continuous-time continuous-space stochastic optimal control problem, where the controller lacks exact knowledge of the underlying diffusion process, relying instead on a finite set of historical disturbance trajectories. In…

Systems and Control · Electrical Eng. & Systems 2023-10-04 Hyuk Park , Duo Zhou , Grani A. Hanasusanto , Takashi Tanaka

Randomized smoothing (RS) has successfully been used to improve the robustness of predictions for deep neural networks (DNNs) by adding random noise to create multiple variations of an input, followed by deciding the consensus. To…

Machine Learning · Computer Science 2024-04-29 Emmanouil Seferis , Stefanos Kollias , Chih-Hong Cheng

Blind face restoration usually synthesizes degraded low-quality data with a pre-defined degradation model for training, while more complex cases could happen in the real world. This gap between the assumed and actual degradation hurts the…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Zhixin Wang , Xiaoyun Zhang , Ziying Zhang , Huangjie Zheng , Mingyuan Zhou , Ya Zhang , Yanfeng Wang
‹ Prev 1 8 9 10 Next ›