English
Related papers

Related papers: The Statistical Cost of Adaptation in Multi-Source…

200 papers

Standard classification treats all errors equally, but in content moderation, medical screening, and safety-critical applications, mistakes on clear-cut cases are far more costly than errors on ambiguous ones. We propose normalized excess…

Machine Learning · Computer Science 2026-05-06 Kabir Kang , Stephen Mussmann

An oracle is a mechanism to decide whether the outputs of the program for the executed test cases are correct. For machine learning programs, such oracle is not available or too difficult to apply. Metamorphic testing is a testing approach…

Software Engineering · Computer Science 2022-09-02 Madhusudan Srinivasan , Upulee Kanewala

Consider the domain of multiclass classification within the adversarial online setting. What is the price of relying on bandit feedback as opposed to full information? To what extent can an adaptive adversary amplify the loss compared to an…

Machine Learning · Computer Science 2024-02-13 Yuval Filmus , Steve Hanneke , Idan Mehalel , Shay Moran

Data science has become increasingly essential for the production of official statistics, as it enables the automated collection, processing, and analysis of large amounts of data. With such data science practices in place, it enables more…

Machine Learning · Statistics 2023-06-08 Cedric De Boom , Michael Reusens

We consider the problem of robust and adaptive model predictive control (MPC) of a linear system, with unknown parameters that are learned along the way (adaptive), in a critical setting where failures must be prevented (robust). This…

Machine Learning · Computer Science 2020-10-22 Edouard Leurent , Denis Efimov , Odalric-Ambrym Maillard

Continual Test-Time Adaptation (CTA) is a challenging task that aims to adapt a source pre-trained model to continually changing target domains. In the CTA setting, a model does not know when the target domain changes, thus facing a drastic…

Machine Learning · Computer Science 2024-03-05 Inseop Chung , Kyomin Hwang , Jayeon Yoo , Nojun Kwak

Estimation and inference in statistics pose significant challenges when data are collected adaptively. Even in linear models, the Ordinary Least Squares (OLS) estimator may fail to exhibit asymptotic normality for single coordinate…

Statistics Theory · Mathematics 2023-10-31 Licong Lin , Mufang Ying , Suvrojit Ghosh , Koulik Khamaru , Cun-Hui Zhang

In the framework of nonparametric multivariate function estimation we are interested in structural adaptation. We assume that the function to be estimated possesses the single-index structure where neither the link function nor the index…

Statistics Theory · Mathematics 2013-04-26 Oleg Lepski , Nora Serdyukova

We present a novel multiple-source unsupervised model for text classification under domain shift. Our model exploits the update rates in document representations to dynamically integrate domain encoders. It also employs a probabilistic…

Computation and Language · Computer Science 2022-03-22 Payam Karisani

Learning under one-sided feedback (i.e., where we only observe the labels for examples we predicted positively on) is a fundamental problem in machine learning -- applications include lending and recommendation systems. Despite this, there…

Machine Learning · Computer Science 2020-10-14 Heinrich Jiang , Qijia Jiang , Aldo Pacchiano

Class imbalance poses a major challenge for machine learning as most supervised learning models might exhibit bias towards the majority class and under-perform in the minority class. Cost-sensitive learning tackles this problem by treating…

Machine Learning · Computer Science 2022-09-20 Vasileios Iosifidis , Symeon Papadopoulos , Bodo Rosenhahn , Eirini Ntoutsi

We propose an adaptive diffusion mechanism to optimize a global cost function in a distributed manner over a network of nodes. The cost function is assumed to consist of a collection of individual components. Diffusion adaptation allows the…

Optimization and Control · Mathematics 2015-06-03 Jianshu Chen , Ali H. Sayed

As transfer learning techniques are increasingly used to transfer knowledge from the source model to the target task, it becomes important to quantify which source models are suitable for a given target task without performing…

Multi-source domain adaptation aims to reduce performance degradation when applying machine learning models to unseen domains. A fundamental challenge is devising the optimal strategy for feature selection. Existing literature is somewhat…

Machine Learning · Statistics 2024-03-12 Ziliang Samuel Zhong , Xiang Pan , Qi Lei

Clinical decision-making often involves selecting tests that are costly, invasive, or time-consuming, motivating individualized, sequential strategies for what to measure and when to stop ascertaining. We study the problem of learning…

Machine Learning · Statistics 2026-04-16 Doudou Zhou , Yiran Zhang , Dian Jin , Yingye Zheng , Lu Tian , Tianxi Cai

Most cost-benefit analyses assume that the estimates of costs and benefits are more or less accurate and unbiased. But what if, in reality, estimates are highly inaccurate and biased? Then the assumption that cost-benefit analysis is a…

General Finance · Quantitative Finance 2021-12-07 Bent Flyvbjerg , Dirk W. Bester

In many practical applications, it is often difficult and expensive to obtain enough large-scale labeled data to train deep neural networks to their full capability. Therefore, transferring the learned knowledge from a separate, labeled…

Machine Learning · Computer Science 2020-02-28 Sicheng Zhao , Bo Li , Colorado Reed , Pengfei Xu , Kurt Keutzer

Source-free domain adaptation (SFDA) aims to adapt a classifier to an unlabelled target data set by only using a pre-trained source model. However, the absence of the source data and the domain shift makes the predictions on the target data…

Computer Vision and Pattern Recognition · Computer Science 2022-08-17 Subhankar Roy , Martin Trapp , Andrea Pilzer , Juho Kannala , Nicu Sebe , Elisa Ricci , Arno Solin

Recently, Transformer has achieved the state-of-the-art performance on many machine translation tasks. However, without syntax knowledge explicitly considered in the encoder, incorrect context information that violates the syntax structure…

Computation and Language · Computer Science 2019-09-06 Chengyi Wang , Shuangzhi Wu , Shujie Liu

Class imbalance in data presents significant challenges for classification tasks. It is fairly common and requires careful handling to obtain desirable performance. Traditional classification algorithms become biased toward the majority…

Machine Learning · Computer Science 2024-10-28 Asif Newaz , Asif Ur Rahman Adib , Taskeed Jabid