English
Related papers

Related papers: Distance Matters For Improving Performance Estimat…

200 papers

Learning from multiple related tasks by knowledge sharing and transfer has become increasingly relevant over the last two decades. In order to successfully transfer information from one task to another, it is critical to understand the…

Machine Learning · Computer Science 2023-01-18 Boyu Wang , Jorge Mendez , Changjian Shui , Fan Zhou , Di Wu , Gezheng Xu , Christian Gagné , Eric Eaton

Transductive inference is an effective means of tackling the data deficiency problem in few-shot learning settings. A popular transductive inference technique for few-shot metric-based approaches, is to update the prototype of each class…

Machine Learning · Computer Science 2020-06-25 Seong Min Kye , Hae Beom Lee , Hoirin Kim , Sung Ju Hwang

A pervasive phenomenon in machine learning applications is distribution shift, where training and deployment conditions for a machine learning model differ. As distribution shift typically results in a degradation in performance, much…

Machine Learning · Statistics 2024-01-23 Philip Amortila , Tongyi Cao , Akshay Krishnamurthy

Rapid progress in representation learning has led to a proliferation of embedding models, and to associated challenges of model selection and practical application. It is non-trivial to assess a model's generalizability to new, candidate…

Machine Learning · Computer Science 2022-02-18 Leo Betthauser , Urszula Chajewska , Maurice Diesendruck , Rohith Pesala

Sepsis is a major cause of mortality in the intensive care units (ICUs). Early intervention of sepsis can improve clinical outcomes for sepsis patients. Machine learning models have been developed for clinical recognition of sepsis. A…

Applications · Statistics 2021-05-21 Jifan Gao , Philip L. Mar , Guanhua Chen

This work considers the problem of estimating the distance between two covariance matrices directly from the data. Particularly, we are interested in the family of distances that can be expressed as sums of traces of functions that are…

Machine Learning · Computer Science 2024-09-19 Roberto Pereira , Xavier Mestre , Davig Gregoratti

Fine-tuning of large pre-trained image and language models on small customized datasets has become increasingly popular for improved prediction and efficient use of limited resources. Fine-tuning requires identification of best models to…

Machine Learning · Computer Science 2023-05-29 Shibal Ibrahim , Natalia Ponomareva , Rahul Mazumder

Computer vision applications predict on digital images acquired by a camera from physical scenes through light. However, conventional robustness benchmarks rely on perturbations in digitized images, diverging from distribution shifts…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Eunsu Baek , Keondo Park , Jiyoon Kim , Hyung-Sin Kim

How well can one expect transfer learning to work in a new setting where the domain is shifted, the task is different, and the architecture changes? Many transfer learning metrics have been proposed to answer this question. But how accurate…

Machine Learning · Computer Science 2025-06-11 Moein Sorkhei , Christos Matsoukas , Johan Fredin Haslum , Emir Konuk , Kevin Smith

There is growing interest in exploring causal effects in target populations via data combination. However, most approaches are tailored to specific settings and lack comprehensive comparative analyses. In this article, we focus on a typical…

Methodology · Statistics 2024-09-17 Peng Wu , Shanshan Luo , Zhi Geng

Symmetry-aware methods for machine learning, such as data augmentation and equivariant architectures, encourage correct model behavior on all transformations (e.g. rotations or permutations) of the original dataset. These methods can…

Machine Learning · Computer Science 2026-03-31 Hannah Lawrence , Elyssa Hofgard , Vasco Portilheiro , Yuxuan Chen , Tess Smidt , Robin Walters

The distance standard deviation, which arises in distance correlation analysis of multivariate data, is studied as a measure of spread. The asymptotic distribution of the empirical distance standard deviation is derived under the assumption…

Statistics Theory · Mathematics 2019-12-12 Dominic Edelmann , Donald Richards , Daniel Vogel

Comparing datasets is a fundamental task in machine learning, essential for various learning paradigms-from evaluating train and test datasets for model generalization to using dataset similarity for detecting data drift. While traditional…

Machine Learning · Computer Science 2025-06-18 Paula Rodriguez-Diaz , Lingkai Kong , Kai Wang , David Alvarez-Melis , Milind Tambe

Distribution shifts, where statistical properties differ between training and test datasets, present a significant challenge in real-world machine learning applications where they directly impact model generalization and robustness. In this…

Machine Learning · Computer Science 2024-05-06 Vegard Flovik

Deep learning models lack shift invariance, making them sensitive to input shifts that cause changes in output. While recent techniques seek to address this for images, our findings show that these approaches fail to provide…

Machine Learning · Computer Science 2025-02-28 Berken Utku Demirel , Christian Holz

Variable selection is of increasing importance to address the difficulties of high dimensionality in many scientific areas. In this paper, we demonstrate a property for distance covariance, which is incorporated in a novel feature screening…

Methodology · Statistics 2014-09-03 Jing Kong , Sijian Wang , Grace Wahba

We consider linear models with scalar responses and covariates from a separable Hilbert space. The aim is to detect change points in the error distribution, based on sequential residual empirical distribution functions. Expansions for those…

Statistics Theory · Mathematics 2024-11-08 Natalie Neumeyer , Leonie Selk

Unpredictable sensor-to-estimator delays fundamentally distort what matters for wireless remote state estimation: not just freshness, but how delay interacts with sensor informativeness and energy efficiency. In this paper, we present a…

Information Theory · Computer Science 2026-01-30 Nho-Duc Tran , Aamir Mahmood , Mikael Gidlund

Randomized controlled trials generate experimental variation that can credibly identify causal effects, but often suffer from limited scale, while observational datasets are large, but often violate desired identification assumptions. To…

Econometrics · Economics 2023-12-27 George Z. Gui

A probabilistic model is said to be calibrated if its predicted probabilities match the corresponding empirical frequencies. Calibration is important for uncertainty quantification and decision making in safety-critical applications. While…

Machine Learning · Computer Science 2020-07-01 Anusri Pampari , Stefano Ermon