English
Related papers

Related papers: Test Distribution-Aware Active Learning: A Princip…

200 papers

Active Learning techniques are used to tackle learning problems where obtaining training labels is costly. In this work we use Meta-Active Learning to learn to select a subset of samples from a pool of unsupervised input for further…

Machine Learning · Computer Science 2019-11-04 Ignasi Mas , Josep Ramon Morros , Veronica Vilaplana

We introduce supervised contrastive active learning (SCAL) and propose efficient query strategies in active learning based on the feature similarity (featuresim) and principal component analysis based feature-reconstruction error (fre) to…

Machine Learning · Computer Science 2022-08-16 Ranganath Krishnan , Nilesh Ahuja , Alok Sinha , Mahesh Subedar , Omesh Tickoo , Ravi Iyer

Image segmentation is a common and challenging task in autonomous driving. Availability of sufficient pixel-level annotations for the training data is a hurdle. Active learning helps learning from small amounts of data by suggesting the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-09 Deepthi Sreenivasaiah , Johannes Otterbach , Thomas Wollmann

Bayesian Optimal Experimental Design (BOED) is a powerful tool to reduce the cost of running a sequence of experiments. When based on the Expected Information Gain (EIG), design optimization corresponds to the maximization of some…

Machine Learning · Statistics 2025-03-14 Jacopo Iollo , Christophe Heinkelé , Pierre Alliez , Florence Forbes

Active Feature Acquisition is an instance-wise, sequential decision making problem. The aim is to dynamically select which feature to measure based on current observations, independently for each test instance. Common approaches either use…

Machine Learning · Computer Science 2025-08-07 Alexander Norcliffe , Changhee Lee , Fergus Imrie , Mihaela van der Schaar , Pietro Lio

Imitation learning is the problem of recovering an expert policy without access to a reward signal. Behavior cloning and GAIL are two widely used methods for performing imitation learning. Behavior cloning converges in a few iterations but…

Machine Learning · Computer Science 2020-11-11 Rohit Jena , Changliu Liu , Katia Sycara

The task of state estimation in active distribution systems faces a major challenge due to the integration of different measurements with multiple reporting rates. As a result, distribution systems are essentially unobservable in real time,…

Optimization and Control · Mathematics 2024-05-13 J. G. De la Varga , S. Pineda , J. M. Morales , Á. Porras

Considering a probability distribution over parameters is known as an efficient strategy to learn a neural network with non-differentiable activation functions. We study the expectation of a probabilistic neural network as a predictor by…

Machine Learning · Computer Science 2023-04-17 Louis Fortier-Dubois , Gaël Letarte , Benjamin Leblanc , François Laviolette , Pascal Germain

We consider an active learning setting where the algorithm has access to a large pool of unlabeled data and a small pool of labeled data. In each iteration, the algorithm chooses few unlabeled data points and obtains their labels from an…

Machine Learning · Computer Science 2019-10-11 Muni Sreenivas Pydi , Vishnu Suresh Lokhande

Gradient-based learning algorithms have an implicit simplicity bias which in effect can limit the diversity of predictors being sampled by the learning procedure. This behavior can hinder the transferability of trained models by (i)…

Machine Learning · Computer Science 2022-11-24 Matteo Pagliardini , Martin Jaggi , François Fleuret , Sai Praneeth Karimireddy

In strategic classification, agents modify their features, at a cost, to ideally obtain a positive classification from the learner's classifier. The typical response of the learner is to carefully modify their classifier to be robust to…

Machine Learning · Computer Science 2024-02-15 Lee Cohen , Saeed Sharifi-Malvajerdi , Kevin Stangl , Ali Vakilian , Juba Ziani

Regression is a fundamental prediction task common in data-centric engineering applications that involves learning mappings between continuous variables. In many engineering applications (e.g.\ structural health monitoring), feature-label…

Effective cooperation is pivotal in distributed learning for multi-agent systems, where the interplay between the quantity and quality of the machine learning models is crucial. This paper reveals the irrationality of indiscriminate…

Machine Learning · Computer Science 2026-01-22 Zewen Yang , Xiaobing Dai , Jiajun Cheng , Yulong Huang , Peng Shi

Active learning emerged as an alternative to alleviate the effort to label huge amount of data for data hungry applications (such as image/video indexing and retrieval, autonomous driving, etc.). The goal of active learning is to…

Computer Vision and Pattern Recognition · Computer Science 2020-10-20 Minghan Li , Xialei Liu , Joost van de Weijer , Bogdan Raducanu

Deep predictive models rely on human supervision in the form of labeled training data. Obtaining large amounts of annotated training data can be expensive and time consuming, and this becomes a critical bottleneck while building such models…

Machine Learning · Statistics 2020-10-01 Bindya Venkatesh , Jayaraman J. Thiagarajan

Learning from previously collected datasets of expert data offers the promise of acquiring robotic policies without unsafe and costly online explorations. However, a major challenge is a distributional shift between the states in the…

Machine Learning · Computer Science 2022-07-19 Alfredo Reichlin , Giovanni Luca Marchetti , Hang Yin , Ali Ghadirzadeh , Danica Kragic

We consider the problem of online learning in the presence of distribution shifts that occur at an unknown rate and of unknown intensity. We derive a new Bayesian online inference approach to simultaneously infer these distribution shifts…

Machine Learning · Statistics 2021-10-28 Aodong Li , Alex Boyd , Padhraic Smyth , Stephan Mandt

Many critical applications, from autonomous scientific discovery to personalized medicine, demand systems that can both strategically acquire the most informative data and instantaneously perform inference based upon it. While amortized…

Machine Learning · Statistics 2025-10-22 Daolang Huang , Xinyi Wen , Ayush Bharti , Samuel Kaski , Luigi Acerbi

Exfiltration of data via email is a serious cybersecurity threat for many organizations. Detecting data exfiltration (anomaly) patterns typically requires labeling, most often done by a human annotator, to reduce the high number of false…

Machine Learning · Computer Science 2023-07-19 Jaturong Kongmanee , Mark Chignell , Khilan Jerath , Abhay Raman

Studies of active learning traditionally assume the target and source data stem from a single domain. However, in realistic applications, practitioners often require active learning with multiple sources of out-of-distribution data, where…

Computation and Language · Computer Science 2022-02-09 Shayne Longpre , Julia Reisler , Edward Greg Huang , Yi Lu , Andrew Frank , Nikhil Ramesh , Chris DuBois