中文
相关论文

相关论文: Distributionally Robust Optimization and Invariant…

200 篇论文

In recent years, discriminative self-supervised methods have made significant strides in advancing various visual tasks. The central idea of learning a data encoder that is robust to data distortions/augmentations is straightforward yet…

计算机视觉与模式识别 · 计算机科学 2023-08-17 Yuewei Yang , Hai Li , Yiran Chen

Deep Neural Networks (DNNs) are increasingly utilized in high-stakes domains like medical diagnostics and autonomous driving where model reliability is critical. However, the research landscape for ensuring this reliability is…

机器学习 · 计算机科学 2026-04-07 Ole Delzer , Sidney Bender

An important goal in deep learning is to learn versatile, high-level feature representations of input data. However, standard networks' representations seem to possess shortcomings that, as we illustrate, prevent them from fully realizing…

We consider a distributionally robust formulation of stochastic optimization problems arising in statistical learning, where robustness is with respect to uncertainty in the underlying data distribution. Our formulation builds on…

最优化与控制 · 数学 2021-06-09 Mert Gürbüzbalaban , Andrzej Ruszczyński , Landi Zhu

Deep learning models can suffer from severe performance degradation when relying on spurious correlations between input features and labels, making the models perform well on training data but have poor prediction accuracy for minority…

机器学习 · 计算机科学 2025-02-17 Tao Wen , Zihan Wang , Quan Zhang , Qi Lei

Dataset bias is a critical challenge in machine learning since it often leads to a negative impact on a model due to the unintended decision rules captured by spurious correlations. Although existing works often handle this issue based on…

机器学习 · 计算机科学 2022-04-05 Seonguk Seo , Joon-Young Lee , Bohyung Han

In this study, the problem of computing a sparse representation of multi-dimensional visual data is considered. In general, such data e.g., hyperspectral images, color images or video data consists of signals that exhibit strong local…

计算机视觉与模式识别 · 计算机科学 2023-03-16 Alexandros Gkillas , Dimitris Ampeliotis , Kostas Berberidis

Modern machine learning models are prone to over-reliance on spurious correlations, which can often lead to poor performance on minority groups. In this paper, we identify surprising and nuanced behavior of finetuned models on worst-group…

机器学习 · 计算机科学 2024-10-29 Tyler LaBonte , John C. Hill , Xinchen Zhang , Vidya Muthukumar , Abhishek Kumar

Deep learning models achieve strong performance across various domains but often rely on spurious correlations, making them vulnerable to distribution shifts. This issue is particularly severe in subpopulation shift scenarios, where models…

机器学习 · 计算机科学 2026-03-03 Subeen Park , Joowang Kim , Hakyung Lee , Sunjae Yoo , Kyungwoo Song

Recent research has highlighted a critical issue known as ``robust fairness", where robust accuracy varies significantly across different classes, undermining the reliability of deep neural networks (DNNs). A common approach to address this…

机器学习 · 计算机科学 2025-01-24 Gaojie Jin , Sihao Wu , Jiaxu Liu , Tianjin Huang , Ronghui Mu

While a broad range of techniques have been proposed to tackle distribution shift, the simple baseline of training on an $\textit{undersampled}$ balanced dataset often achieves close to state-of-the-art-accuracy across several popular…

机器学习 · 计算机科学 2023-06-21 Niladri S. Chatterji , Saminul Haque , Tatsunori Hashimoto

Nonlinear regression has been extensively employed in many computer vision problems (e.g., crowd counting, age estimation, affective computing). Under the umbrella of deep learning, two common solutions exist i) transforming nonlinear…

计算机视觉与模式识别 · 计算机科学 2019-08-27 Le Zhang , Zenglin Shi , Ming-Ming Cheng , Yun Liu , Jia-Wang Bian , Joey Tianyi Zhou , Guoyan Zheng , Zeng Zeng

We consider the problem of learning a graph from a finite set of noisy graph signal observations, the goal of which is to find a smooth representation of the graph signal. Such a problem is motivated by the desire to infer relational…

机器学习 · 计算机科学 2023-02-08 Xiaolu Wang , Yuen-Man Pun , Anthony Man-Cho So

Deep neural networks give state-of-the-art accuracy for reconstructing images from few and noisy measurements, a problem arising for example in accelerated magnetic resonance imaging (MRI). However, recent works have raised concerns that…

图像与视频处理 · 电气工程与系统科学 2021-06-14 Mohammad Zalbagi Darestani , Akshay S. Chaudhari , Reinhard Heckel

We study the problem of selecting limited features to observe such that models trained on them can perform well simultaneously across multiple subpopulations. This problem has applications in settings where collecting each feature is…

机器学习 · 计算机科学 2025-10-27 Maitreyi Swaroop , Tamar Krishnamurti , Bryan Wilder

The deep neural network (DNN) has been proven effective in various domains. However, they often struggle to perform well on certain minority groups during inference, despite showing strong performance on the majority of data groups. This is…

机器学习 · 计算机科学 2023-12-11 Jiaxu Zhao , Lu Yin , Shiwei Liu , Meng Fang , Mykola Pechenizkiy

Neural networks employ spurious correlations in their predictions, resulting in decreased performance when these correlations do not hold. Recent works suggest fixing pretrained representations and training a classification head that does…

机器学习 · 计算机科学 2023-06-23 Rafayel Darbinyan , Hrayr Harutyunyan , Aram H. Markosyan , Hrant Khachatrian

Deep neural networks often exploit *spurious* features that are present in the majority of examples within a class during training. This leads to *poor worst-group test accuracy*, i.e., poor accuracy for minority groups that lack these…

机器学习 · 计算机科学 2025-04-18 Siddharth Joshi , Yu Yang , Yihao Xue , Wenhan Yang , Baharan Mirzasoleiman

Group distributionally robust optimization, which aims to improve robust accuracies -- worst-group and unbiased accuracies -- is a prominent algorithm used to mitigate spurious correlations and address dataset bias. Although existing…

机器学习 · 计算机科学 2024-12-23 Seonguk Seo , Bohyung Han

Self-supervised learning in computer vision aims to leverage the inherent structure and relationships within data to learn meaningful representations without explicit human annotation, enabling a holistic understanding of visual scenes.…

计算机视觉与模式识别 · 计算机科学 2023-08-14 Prakash Chandra Chhipa , Johan Rodahl Holmgren , Kanjar De , Rajkumar Saini , Marcus Liwicki