English
Related papers

Related papers: AutoSpearman: Automatically Mitigating Correlated …

200 papers

Although deep learning models in medical imaging often achieve excellent classification performance, they can rely on shortcut learning, exploiting spurious correlations or confounding factors that are not causally related to the target…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Sarah Müller , Philipp Berens

Clinical machine learning applications are often plagued with confounders that are clinically irrelevant, but can still artificially boost the predictive performance of the algorithms. Confounding is especially problematic in mobile health…

Applications · Statistics 2018-11-29 Elias Chaibub Neto

For data sets with similar features, for example highly correlated features, most existing stability measures behave in an undesired way: They consider features that are almost identical but have different identifiers as different features.…

Machine Learning · Statistics 2021-01-18 Andrea Bommert , Jörg Rahnenführer

Feature selection has been recently used in the area of software engineering for improving the accuracy and robustness of software cost models. The idea behind selecting the most informative subset of features from a pool of available cost…

Software Engineering · Computer Science 2023-12-21 Efi Papatheocharous , Harris Papadopoulos , Andreas S. Andreou

Debiased machine learning estimators for smooth functionals in nonparametric models can exhibit substantial variability and instability, often leading practitioners to instead rely on parametric or semiparametric working models. Such…

Methodology · Statistics 2026-03-20 Lars van der Laan , Marco Carone , Alex Luedtke , Mark van der Laan

We propose a method to overcome the usual limitation of current data processing techniques in optical and infrared long-baseline interferometry: most reduction pipelines assume uncorrelated statistical errors and ignore systematics. We use…

Instrumentation and Methods for Astrophysics · Physics 2019-01-23 Régis Lachaume , Markus Rabus , Andrés Jordán , Rafael Brahm , Tabetha Boyajian , Kaspar von Braun , Jean-Philippe Berger

This paper addresses the problem of correlation estimation in sets of compressed images. We consider a framework where images are represented under the form of linear measurements due to low complexity sensing or security requirements. We…

Computer Vision and Pattern Recognition · Computer Science 2011-12-20 Vijayaraghavan Thirumalai , Pascal Frossard

This study proposes a framework for the automated hyperparameter optimization of a bearing fault detection pipeline for permanent magnet synchronous motors (PMSMs) without the need of external sensors. A automated machine learning (AutoML)…

Signal Processing · Electrical Eng. & Systems 2023-06-21 Tobias Wagner , Alexander Gepperth , Elmar Engels

Models trained with empirical risk minimization (ERM) are prone to be biased towards spurious correlations between target labels and bias attributes, which leads to poor performance on data groups lacking spurious correlations. It is…

Machine Learning · Computer Science 2024-12-23 Hyeonggeun Han , Sehwan Kim , Hyungjun Joo , Sangwoo Hong , Jungwoo Lee

Natural language understanding (NLU) models tend to rely on spurious correlations (i.e., dataset bias) to achieve high performance on in-distribution datasets but poor performance on out-of-distribution ones. Most of the existing debiasing…

Computation and Language · Computer Science 2022-09-14 Shihan Dou , Rui Zheng , Ting Wu , SongYang Gao , Junjie Shan , Qi Zhang , Yueming Wu , Xuanjing Huang

Feature screening is an important method to reduce the dimension and capture informative variables in ultrahigh-dimensional data analysis. Many methods have been developed for feature screening. These methods, however, are challenged by…

Methodology · Statistics 2019-01-08 Li-Pang Chen

Despite the rapid development and great success of machine learning models, extensive studies have exposed their disadvantage of inheriting latent discrimination and societal bias from the training data. This phenomenon hinders their…

Machine Learning · Computer Science 2021-12-30 Tianxiang Zhao , Enyan Dai , Kai Shu , Suhang Wang

Machine Translation (MT) evaluation metrics assess translation quality automatically. Recently, researchers have employed MT metrics for various new use cases, such as data filtering and translation re-ranking. However, most MT metrics…

Computation and Language · Computer Science 2024-10-08 Stefano Perrella , Lorenzo Proietti , Pere-Lluís Huguet Cabot , Edoardo Barba , Roberto Navigli

Subset selection for multiple linear regression aims to construct a regression model that minimizes errors by selecting a small number of explanatory variables. Once a model is built, various statistical tests and diagnostics are conducted…

Machine Learning · Statistics 2020-09-04 Seokhyun Chung , Young Woong Park , Taesu Cheong

Checking software application suitability using automated software tools has become a vital element for most organisations irrespective of whether they produce in-house software or simply customise off-the-shelf software applications for…

Software Engineering · Computer Science 2015-08-05 Rajesh Mathur , Scott Miles , Miao Du

Seam-cutting and seam-driven techniques have been proven effective for handling imperfect image series in image stitching. Generally, seam-driven is to utilize seam-cutting to find a best seam from one or finite alignment hypotheses based…

Computer Vision and Pattern Recognition · Computer Science 2018-05-25 Tianli Liao , Jing Chen , Yifang Xu

In a typical supervised machine learning setting, the predictions on all test instances are based on a common subset of features discovered during model training. However, using a different subset of features that is most informative for…

Machine Learning · Computer Science 2021-06-10 Yasitha Warahena Liyanage , Daphney-Stavroula Zois , Charalampos Chelmis

Fine-tuning a pretrained language model on a curated dataset can produce spurious correlations between the fine-tuning task and unintended latent factors -- such as misaligned personas or political slant -- that the curation procedure has…

Machine Learning · Statistics 2026-05-28 Ciarán M. Gilligan-Lee , Joseph Egan , Yuchen Zhu , Michael O'Riordan

Optimization software enables the solution of problems with millions of variables and associated parameters. These parameters are, however, often uncertain and represented with an analytical description of the parameter's distribution or…

Optimization and Control · Mathematics 2025-01-17 John R. Birge

Scan line levelling, a ubiquitous and often necessary step in AFM data processing, can cause a severe bias on measured roughness parameters such as mean square roughness or correlation length. Although bias estimates have been formulated,…

Data Analysis, Statistics and Probability · Physics 2024-06-06 David Nečas