English
Related papers

Related papers: Distributionally Robust Safe Screening

200 papers

Machine learning algorithms with empirical risk minimization are vulnerable under distributional shifts due to the greedy adoption of all the correlations found in training data. Recently, there are robust learning methods aiming at this…

Machine Learning · Computer Science 2021-05-12 Jiashuo Liu , Zheyan Shen , Peng Cui , Linjun Zhou , Kun Kuang , Bo Li , Yishi Lin

Distributionally robust optimization (DRO) is a powerful technique to train robust models against data distribution shift. This paper aims to solve regularized nonconvex DRO problems, where the uncertainty set is modeled by a so-called…

Optimization and Control · Mathematics 2025-06-30 Yufeng Yang , Yi Zhou , Zhaosong Lu

As its name suggests, sufficient dimension reduction (SDR) targets to estimate a subspace from data that contains all information sufficient to explain a dependent variable. Ample approaches exist to SDR, some of the most recent of which…

Methodology · Statistics 2020-12-15 Emmanuel Jordy Menvouta , Sven Serneels , Tim Verdonck

Water distribution systems (WDSs) are an important part of critical infrastructure becoming increasingly significant in the face of climate change and urban population growth. We propose a robust and scalable surrogate deep learning (DL)…

Neural and Evolutionary Computing · Computer Science 2025-02-19 Inaam Ashraf , André Artelt , Barbara Hammer

Human visual system is modeled in engineering field providing feature-engineered methods which detect contrasted/surprising/unusual data into images. This data is "interesting" for humans and leads to numerous applications. Deep learning…

Computer Vision and Pattern Recognition · Computer Science 2021-09-24 Phutphalla Kong , Matei Mancas , Bernard Gosselin , Kimtho Po

Unsupervised anomaly detection is vital in industrial fields, with reconstruction-based methods favored for their simplicity and effectiveness. However, reconstruction methods often encounter an identical shortcut issue, where both normal…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Wei Luo , Haiming Yao , Zhenfeng Qiang , Xiaotian Zhang , Weihang Zhang

Due to the existence of label noise in web images and the high memorization capacity of deep neural networks, training deep fine-grained (FG) models directly through web images tends to have an inferior recognition ability. In the…

Computer Vision and Pattern Recognition · Computer Science 2020-08-07 Zeren Sun , Xian-Sheng Hua , Yazhou Yao , Xiu-Shen Wei , Guosheng Hu , Jian Zhang

Remote Sensing Change Detection (RS-CD) aims to detect relevant changes from Multi-Temporal Remote Sensing Images (MT-RSIs), which aids in various RS applications such as land cover, land use, human development analysis, and disaster…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Wele Gedara Chaminda Bandara , Vishal M. Patel

We consider the problem of learning a control policy that is robust against the parameter mismatches between the training environment and testing environment. We formulate this as a distributionally robust reinforcement learning (DR-RL)…

Machine Learning · Computer Science 2023-05-23 Zaiyan Xu , Kishan Panaganti , Dileep Kalathil

Stochastic variance reduced methods have gained a lot of interest recently for empirical risk minimization due to its appealing run time complexity. When the data size is large and disjointly stored on different machines, it becomes…

Machine Learning · Computer Science 2020-08-26 Shicong Cen , Huishuai Zhang , Yuejie Chi , Wei Chen , Tie-Yan Liu

We consider the problem of learning a sparse rule model, a prediction model in the form of a sparse linear combination of rules, where a rule is an indicator function defined over a hyper-rectangle in the input space. Since the number of…

Machine Learning · Statistics 2025-03-13 Hiroki Kato , Hiroyuki Hanada , Ichiro Takeuchi

In the realm of reinforcement learning (RL), accounting for risk is crucial for making decisions under uncertainty, particularly in applications where safety and reliability are paramount. In this paper, we introduce a general framework on…

Machine Learning · Computer Science 2024-02-29 Yu Chen , Xiangcheng Zhang , Siwei Wang , Longbo Huang

We propose sequenced-replacement sampling (SRS) for training deep neural networks. The basic idea is to assign a fixed sequence index to each sample in the dataset. Once a mini-batch is randomly drawn in each training iteration, we refill…

Machine Learning · Computer Science 2018-10-22 Chiu Man Ho , Dae Hoon Park , Wei Yang , Yi Chang

Distributionally Robust Optimization (DRO), which aims to find an optimal decision that minimizes the worst case cost over the ambiguity set of probability distribution, has been widely applied in diverse applications, e.g., network…

Machine Learning · Computer Science 2022-12-20 Yang Jiao , Kai Yang , Dongjin Song

U-shaped networks are widely used in various medical image tasks, such as segmentation, restoration and reconstruction, but most of them usually rely on centralized learning and thus ignore privacy issues. To address the privacy concerns,…

Image and Video Processing · Electrical Eng. & Systems 2022-12-14 Ziyuan Yang , Yingyu Chen , Huijie Huangfu , Maosong Ran , Hui Wang , Xiaoxiao Li , Yi Zhang

Modern consumer cameras usually employ the rolling shutter (RS) mechanism, where images are captured by scanning scenes row-by-row, yielding RS distortions for dynamic scenes. To correct RS distortions, existing methods adopt a fully…

Computer Vision and Pattern Recognition · Computer Science 2023-09-15 Wei Shang , Dongwei Ren , Chaoyu Feng , Xiaotao Wang , Lei Lei , Wangmeng Zuo

Machine learning models often have uneven performance among subpopulations (a.k.a., groups) in the data distributions. This poses a significant challenge for the models to generalize when the proportions of the groups shift during…

Machine Learning · Computer Science 2025-03-11 Rui Qiao , Zhaoxuan Wu , Jingtan Wang , Pang Wei Koh , Bryan Kian Hsiang Low

Outlying observations can be challenging to handle and adversely affect subsequent analyses, especially in data with increasing dimensional complexity. Although outliers are not always undesired anomalies in the data and may possess…

Methodology · Statistics 2025-09-18 Anthony-Alexander Christidis , Gabriela Cohen-Freue

In the era of exceptionally data-hungry models, careful selection of the training data is essential to mitigate the extensive costs of deep learning. Data pruning offers a solution by removing redundant or uninformative samples from the…

Machine Learning · Computer Science 2025-02-11 Artem Vysogorets , Kartik Ahuja , Julia Kempe

Deep reinforcement learning (DRL) requires the collection of interventional data, which is sometimes expensive and even unethical in the real world, such as in the autonomous driving and the medical field. Offline reinforcement learning…

Machine Learning · Computer Science 2023-06-12 Wenxuan Zhu , Chao Yu , Qiang Zhang