English
Related papers

Related papers: Harnessing the Power of Vicinity-Informed Analysis…

200 papers

We study the open-set label shift problem, where the test data may include a novel class absent from training. This setting is challenging because both the class proportions and the distribution of the novel class are not identifiable…

Methodology · Statistics 2025-09-19 Siyan Liu , Yukun Liu , Qinglong Tian , Pengfei Li , Jing Qin

The use of transfer learning with deep neural networks has increasingly become widespread for deploying well-tested computer vision systems to newer domains, especially those with limited datasets. We describe a transfer learning use case…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Rashik Shadman , M. G. Sarwar Murshed , Edward Verenich , Alvaro Velasquez , Faraz Hussain

Recent advances in deep learning have achieved impressive gains in classification accuracy on a variety of types of data, including images and text. Despite these gains, however, concerns have been raised about the calibration, robustness,…

Machine Learning · Computer Science 2018-11-20 Dallas Card , Michael Zhang , Noah A. Smith

Distribution shifts are common in real-world datasets and can affect the performance and reliability of deep learning models. In this paper, we study two types of distribution shifts: diversity shifts, which occur when test samples exhibit…

Computer Vision and Pattern Recognition · Computer Science 2023-12-22 Alceu Bissoto , Catarina Barata , Eduardo Valle , Sandra Avila

Estimating causal effects among different events is of great importance to critical fields such as drug development. Nevertheless, the data features associated with events may be distributed across various silos and remain private within…

Machine Learning · Computer Science 2024-01-05 Yuxuan Liu , Haozhao Wang , Shuang Wang , Zhiming He , Wenchao Xu , Jialiang Zhu , Fan Yang

Due to its probabilistic nature, fault prognostics is a prime example of a use case for deep learning utilizing big data. However, the low availability of such data sets combined with the high effort of fitting, parameterizing and…

Machine Learning · Computer Science 2023-01-05 Benjamin Maschler

As a new classification platform, deep learning has recently received increasing attention from researchers and has been successfully applied to many domains. In some domains, like bioinformatics and robotics, it is very difficult to…

Machine Learning · Computer Science 2018-08-13 Chuanqi Tan , Fuchun Sun , Tao Kong , Wenchang Zhang , Chao Yang , Chunfang Liu

We consider the problem of weakly supervised object detection, where the training samples are annotated using only image-level labels that indicate the presence or absence of an object category. In order to model the uncertainty in the…

Computer Vision and Pattern Recognition · Computer Science 2018-11-27 Aditya Arun , C. V. Jawahar , M. Pawan Kumar

Transfer learning methods address the situation where little labeled training data from the "target" problem exists, but much training data from a related "source" domain is available. However, the overwhelming majority of transfer learning…

Machine Learning · Computer Science 2017-12-27 Aubrey Gress , Ian Davidson

A critical barrier to learning an accurate decision rule for outlier detection is the scarcity of outlier data. As such, practitioners often turn to the use of similar but imperfect outlier data from which they might transfer information to…

Machine Learning · Computer Science 2023-10-10 Mohammadreza M. Kalan , Samory Kpotufe

This paper presents a novel method for embedding transfer, a task of transferring knowledge of a learned embedding model to another. Our method exploits pairwise similarities between samples in the source embedding space as the knowledge,…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Sungyeon Kim , Dongwon Kim , Minsu Cho , Suha Kwak

Current methods for covariate-shift adaptation use unlabelled data to compute importance weights or domain-invariant features, while the final model is trained on labelled data only. Here, we consider a particular case of covariate shift…

Machine Learning · Statistics 2019-02-28 Julius von Kügelgen , Alexander Mey , Marco Loog

We study the fundamental problem of transfer learning where a learning algorithm collects data from some source distribution $P$ but needs to perform well with respect to a different target distribution $Q$. A standard change of measure…

Machine Learning · Computer Science 2024-03-19 Alkis Kalavasis , Ilias Zadik , Manolis Zampetakis

Using transfer learning to adapt a pre-trained "source model" to a downstream "target task" can dramatically increase performance with seemingly no downside. In this work, we demonstrate that there can exist a downside after all: bias…

Machine Learning · Computer Science 2022-07-07 Hadi Salman , Saachi Jain , Andrew Ilyas , Logan Engstrom , Eric Wong , Aleksander Madry

As a prominent challenge in addressing real-world issues within a dynamic environment, label shift, which refers to the learning setting where the source (training) and target (testing) label distributions do not match, has recently…

Machine Learning · Computer Science 2024-11-06 Ruidong Fan , Xiao Ouyang , Hong Tao , Yuhua Qian , Chenping Hou

When labeled data is scarce for a specific target task, transfer learning often offers an effective solution by utilizing data from a related source task. However, when transferring knowledge from a less related source, it may inversely…

Machine Learning · Computer Science 2019-10-08 Zirui Wang , Zihang Dai , Barnabás Póczos , Jaime Carbonell

We consider the problem of transfer learning in Neyman-Pearson classification, where the objective is to minimize the error w.r.t. a distribution $\mu_1$, subject to the constraint that the error w.r.t. a distribution $\mu_0$ remains below…

Machine Learning · Computer Science 2025-11-11 Mohammadreza M. Kalan , Yuyang Deng , Eitan J. Neugut , Samory Kpotufe

Many existing covariate shift adaptation methods estimate sample weights given to loss values to mitigate the gap between the source and the target distribution. However, estimating the optimal weights typically involves computationally…

Machine Learning · Statistics 2024-07-01 François Portier , Lionel Truquet , Ikko Yamane

Data shift is a phenomenon present in many real-world applications, and while there are multiple methods attempting to detect shifts, the task of localizing and correcting the features originating such shifts has not been studied in depth.…

Machine Learning · Computer Science 2023-12-08 Miriam Barrabes , Daniel Mas Montserrat , Margarita Geleta , Xavier Giro-i-Nieto , Alexander G. Ioannidis

Sequential sensor data is generated in a wide variety of practical applications. A fundamental challenge involves learning effective classifiers for such sequential data. While deep learning has led to impressive performance gains in recent…

Machine Learning · Computer Science 2020-10-07 Nauman Ahad , Mark A. Davenport