English
Related papers

Related papers: Leveraging Unlabeled Data to Predict Out-of-Distri…

200 papers

Neoadjuvant therapy (NAT) for breast cancer is a common treatment option in clinical practice. Tumor cellularity (TC), which represents the percentage of invasive tumors in the tumor bed, has been widely used to quantify the response of…

Image and Video Processing · Electrical Eng. & Systems 2022-06-15 Xiangyu Li , Xinjie Liang , Gongning Luo , Wei Wang , Kuanquan Wang , Shuo Li

Test-time adaptation aims to improve model robustness under distribution shifts by adapting models with access to unlabeled target samples. A primary cause of performance degradation under such shifts is the model's reliance on features…

Machine Learning · Computer Science 2025-10-14 Yingnan Liu , Rui Qiao , Mong Li Lee , Wynne Hsu

Unsupervised domain adaptation (UDA) is a statistical learning problem when the distribution of training (source) data is different from that of test (target) data. In this setting, one has access to labeled data only from the source domain…

Machine Learning · Computer Science 2026-02-24 Seonghwi Kim , Sung Ho Jo , Wooseok Ha , Minwoo Chae

When labeled data is insufficient, semi-supervised learning with the pseudo-labeling technique can significantly improve the performance of automatic speech recognition. However, pseudo-labels are often noisy, containing numerous incorrect…

Audio and Speech Processing · Electrical Eng. & Systems 2023-08-15 Han Zhu , Dongji Gao , Gaofeng Cheng , Daniel Povey , Pengyuan Zhang , Yonghong Yan

Learning from a label distribution has achieved promising results on ordinal regression tasks such as facial age and head pose estimation wherein, the concept of adaptive label distribution learning (ALDL) has drawn lots of attention…

Computer Vision and Pattern Recognition · Computer Science 2022-04-04 Qiang Li , Jingjing Wang , Zhaoliang Yao , Yachun Li , Pengju Yang , Jingwei Yan , Chunmao Wang , Shiliang Pu

Domain adaptation is an important technique to alleviate performance degradation caused by domain shift, e.g., when training and test data come from different domains. Most existing deep adaptation methods focus on reducing domain shift by…

Machine Learning · Computer Science 2019-06-25 Jun Wen , Nenggan Zheng , Junsong Yuan , Zhefeng Gong , Changyou Chen

There is growing evidence that converting targets to soft targets in supervised learning can provide considerable gains in performance. Much of this work has considered classification, converting hard zero-one values to soft labels---such…

Machine Learning · Statistics 2018-06-13 Ehsan Imani , Martha White

Continual Test-Time Adaptation (CTTA) is proposed to migrate a source pre-trained model to continually changing target distributions, addressing real-world dynamism. Existing CTTA methods mainly rely on entropy minimization or…

Computer Vision and Pattern Recognition · Computer Science 2024-03-28 Jiaming Liu , Ran Xu , Senqiao Yang , Renrui Zhang , Qizhe Zhang , Zehui Chen , Yandong Guo , Shanghang Zhang

Deep neural networks suffer from the overconfidence issue in the open world, meaning that classifiers could yield confident, incorrect predictions for out-of-distribution (OOD) samples. Thus, it is an urgent and challenging task to detect…

Computer Vision and Pattern Recognition · Computer Science 2022-04-12 Qiuyu Zhu , Guohui Zheng , Yingying Yan

Although deep neural networks yield high classification accuracy given sufficient training data, their predictions are typically overconfident or under-confident, i.e., the prediction confidences cannot truly reflect the accuracy. Post-hoc…

Computer Vision and Pattern Recognition · Computer Science 2024-02-15 Jiexin Wang , Jiahao Chen , Bing Su

Training automatic speech recognition (ASR) systems requires large amounts of well-curated paired data. However, human annotators usually perform "non-verbatim" transcription, which can result in poorly trained models. In this paper, we…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-28 Dongji Gao , Hainan Xu , Desh Raj , Leibny Paola Garcia Perera , Daniel Povey , Sanjeev Khudanpur

We consider a collaborative learning setting where the goal of each agent is to improve their own model by leveraging the expertise of collaborators, in addition to their own training data. To facilitate the exchange of expertise among…

Machine Learning · Computer Science 2023-11-16 Dongyang Fan , Celestine Mendler-Dünner , Martin Jaggi

Research on Knowledge Tracing (KT) models traditionally focuses on improving predictive accuracy. However, responsible real-world deployment requires models to know when to defer uncertain predictions to a human teacher. We introduce an…

Machine Learning · Computer Science 2026-05-04 Joshua Mitton , Prarthana Bhattacharyya , Ralph Abboud , Simon Woodhead

To create state-of-the-art models for many downstream tasks, it has become common practice to fine-tune a pre-trained large vision model. However, it remains an open question of how to best determine which of the many possible model…

Machine Learning · Computer Science 2025-12-08 Simon Guiroy , Mats Richter , Sarath Chandar , Christopher Pal

A multi-label classifier estimates the binary label state (relevant vs irrelevant) for each of a set of concept labels, for any given instance. Probabilistic multi-label classifiers provide a predictive posterior distribution over all…

Machine Learning · Computer Science 2022-09-12 Laurence A. F. Park , Jesse Read

Domain shift is a significant challenge in machine learning, particularly in medical applications where data distributions differ across institutions due to variations in data collection practices, equipment, and procedures. This can…

Machine Learning · Computer Science 2025-06-30 Takumi Okuo , Shinnosuke Matsuo , Shota Harada , Kiyohito Tanaka , Ryoma Bise

Domain adaptation aims to mitigate performance degradation caused by distribution shifts between a labeled source domain and an unlabeled or sparsely labeled target domain. Most existing approaches estimate domain discrepancy either in…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Xi Ding , Lei Wang , Syuan-Hao Li , Yongsheng Gao

In the industrial practice of machine learning and statistical modeling, practitioners often work under the assumption of accessible, static, labeled data for evaluation and training. However, this assumption often deviates from reality,…

Machine Learning · Computer Science 2024-10-14 Kevin Slote , Elaine Lee

Understanding the confidence with which a machine learning model classifies an input datum is an important, and perhaps under-investigated, concept. In this paper, we propose a new calibration metric, the Entropic Calibration Difference…

Machine Learning · Computer Science 2025-02-21 Daniel James Sumler , Lee Devlin , Simon Maskell , Richard O. Lane

Deep neural networks have demonstrated remarkable advancements in various fields using large, well-annotated datasets. However, real-world data often exhibit long-tailed distributions and label noise, significantly degrading generalization…

Computer Vision and Pattern Recognition · Computer Science 2024-07-25 Jae Soon Baik , In Young Yoon , Kun Hoon Kim , Jun Won Choi