English
Related papers

Related papers: Ranking Models in Unlabeled New Environments

200 papers

State-of-the-art machine learning models require access to significant amount of annotated data in order to achieve the desired level of performance. While unlabelled data can be largely available and even abundant, annotation process can…

Machine Learning · Computer Science 2020-10-15 Rahaf Aljundi , Nikolay Chumerin , Daniel Olmeda Reino

In low-resource settings, model transfer can help to overcome a lack of labeled data for many tasks and domains. However, predicting useful transfer sources is a challenging problem, as even the most similar sources might lead to unexpected…

Computation and Language · Computer Science 2021-11-01 Lukas Lange , Jannik Strötgen , Heike Adel , Dietrich Klakow

Transductive learning is a supervised machine learning task in which, unlike in traditional inductive learning, the unlabelled data that require labelling are a finite set and are available at training time. Similarly to inductive learning…

Machine Learning · Computer Science 2025-07-31 Lorenzo Volpi , Alejandro Moreo , Fabrizio Sebastiani

Several works in computer vision have demonstrated the effectiveness of active learning for adapting the recognition model when new unlabeled data becomes available. Most of these works consider that labels obtained from the annotator are…

Computer Vision and Pattern Recognition · Computer Science 2020-10-20 Sudipta Paul , Shivkumar Chandrasekaran , B. S. Manjunath , Amit K. Roy-Chowdhury

Semi-supervised domain adaptation aims to classify data belonging to a target domain by utilizing a related label-rich source domain and very few labeled examples of the target domain. Here, we propose a novel framework, Pred&Guide, which…

Computer Vision and Pattern Recognition · Computer Science 2022-11-23 Megh Manoj Bhalerao , Anurag Singh , Soma Biswas

Adapting pre-trained deep learning models to new and unknown environments remains a major challenge in underwater acoustic localization. We show that although the performance of pre-trained models suffers from mismatch between the training…

Sound · Computer Science 2025-10-14 Dariush Kari , Hari Vishnu , Andrew C. Singer

We consider the problem of personalization of online services from the viewpoint of ad targeting, where we seek to find the best ad categories to be shown to each user, resulting in improved user experience and increased advertisers'…

Artificial Intelligence · Computer Science 2016-06-30 Nemanja Djuric , Mihajlo Grbovic , Vladan Radosavljevic , Narayan Bhamidipati , Slobodan Vucetic

One of the key challenges of performing label prediction over a data stream concerns with the emergence of instances belonging to unobserved class labels over time. Previously, this problem has been addressed by detecting such instances and…

Machine Learning · Computer Science 2019-01-29 Zhuoyi Wang , Zelun Kong , Hemeng Tao , Swarup Chandra , Latifur Khan

We consider a setting where agents take action by following their role models in a social network, and study strategies for a social planner to help agents by revealing whether the role models are positive or negative. Specifically, agents…

Artificial Intelligence · Computer Science 2026-03-04 Avrim Blum , Keziah Naggita , Matthew R. Walter , Jingyan Wang

Neural network approaches in recommender systems have shown remarkable success by representing a large set of items as a learnable vector embedding table. However, infrequent items may suffer from inadequate training opportunities, making…

Information Retrieval · Computer Science 2023-12-12 Jinseok Seol , Minseok Gang , Sang-goo Lee , Jaehui Park

In the context of supervised statistical learning, it is typically assumed that the training set comes from the same distribution that draws the test samples. When this is not the case, the behavior of the learned model is unpredictable and…

Machine Learning · Computer Science 2022-05-12 Antonio-Javier Gallego , Jorge Calvo-Zaragoza , Robert B. Fisher

Labelled data often comes at a high cost as it may require recruiting human labelers or running costly experiments. At the same time, in many practical scenarios, one already has access to a partially labelled, potentially biased dataset…

Machine Learning · Computer Science 2021-06-15 Fnu Devvrit , Nived Rajaraman , Pranjal Awasthi

We study a new highly-practical problem setting that enables resource-constrained edge devices to adapt a pre-trained model to their local data distributions. Recognizing that device's data are likely to come from multiple latent domains…

Machine Learning · Computer Science 2024-02-02 Ondrej Bohdal , Da Li , Shell Xu Hu , Timothy Hospedales

Recent advances in deep learning have significantly improved the performance of various computer vision applications. However, discovering novel categories in an incremental learning scenario remains a challenging problem due to the lack of…

Computer Vision and Pattern Recognition · Computer Science 2023-11-03 Hyungmin Kim , Sungho Suh , Daehwan Kim , Daun Jeong , Hansang Cho , Junmo Kim

We tackle the problem of discovering novel classes in an image collection given labelled examples of other classes. This setting is similar to semi-supervised learning, but significantly harder because there are no labelled examples for the…

Computer Vision and Pattern Recognition · Computer Science 2020-02-14 Kai Han , Sylvestre-Alvise Rebuffi , Sebastien Ehrhardt , Andrea Vedaldi , Andrew Zisserman

Models that top leaderboards often perform unsatisfactorily when deployed in real world applications; this has necessitated rigorous and expensive pre-deployment model testing. A hitherto unexplored facet of model performance is: Are our…

Computation and Language · Computer Science 2021-06-11 Swaroop Mishra , Anjana Arunkumar

Domain adaptation for visual recognition has undergone great progress in the past few years. Nevertheless, most existing methods work in the so-called closed-set scenario, assuming that the classes depicted by the target images are exactly…

Computer Vision and Pattern Recognition · Computer Science 2018-06-01 Mahsa Baktashmotlagh , Masoud Faraki , Tom Drummond , Mathieu Salzmann

Domain adaptation aims to transfer the knowledge learned on (data-rich) source domains to (low-resource) target domains, and a popular method is invariant representation learning, which matches and aligns the data distributions on the…

Information Retrieval · Computer Science 2023-11-01 Ruicheng Xian , Honglei Zhuang , Zhen Qin , Hamed Zamani , Jing Lu , Ji Ma , Kai Hui , Han Zhao , Xuanhui Wang , Michael Bendersky

When trained on diverse labeled data, machine learning models have proven themselves to be a powerful tool in all facets of society. However, due to budget limitations, deliberate or non-deliberate censorship, and other problems during data…

Machine Learning · Statistics 2022-03-25 Thomas Kehrenberg , Myles Bartlett , Viktoriia Sharmanska , Novi Quadrianto

Enabling robots to learn novel visuomotor skills in a data-efficient manner remains an unsolved problem with myriad challenges. A popular paradigm for tackling this problem is through leveraging large unlabeled datasets that have many…

Robotics · Computer Science 2023-05-16 Maximilian Du , Suraj Nair , Dorsa Sadigh , Chelsea Finn